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ABSTRACT 

A  general  framework  for  a  computer  system  that 
accepts  and  analyzes  the  vast  quantity  of  data  generated  by  a 
modern  sonar  suite  has  been  developed.  The  output  of  this 
computer  system  is  an  array  of  alerting  functions  that  measure 
the  likelihood  that  a  given  coordinate  vector  is  the  location  of 
a  target.  In  particular,  the  framework  combines  the  output  of 
active  high-  and  low-Doppler  sonar  processors  and  wideband  and 
narrowband  passive  processors.  The  active  high-  and  low-Doppler 
processor  portion  was  developed  and  tested  during  this  study. 
Performance  tests  using  simulated  data  established  that  the 
combined  active  processor  gave  better  performance  than  each 
individual  processor  and  its  single  output  channel  gave  more 
uniform  performance  over  variations  in  target  Doppler'than  was 
available  with  the  two  separate  channels.  An  observer  test  was 
conducted  using  ARL  processed  AN/SQS-23  recorded  sea  data  with 
^-.injected  target  signals. 
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1.0  INTRODUCTION 

Two  of  the  major  problems  faced  by  modern  sonar 
systems  are  the  consolidation  and  presentation  of  a  potentially 
large  quantity  of  data  and  the  ability  of  the  sonar  operator  to 
effectively  assimilate  and  process  these  data.  Potentially,  a 
modern  sonar  suite  would  be  capable  of  delivering  thousands  of 
channels  of  information  to  the  operator  who  in  turn,  even  in  an 
alert  state,  cannot  process  all  of  this  information.  Moreover, 
operators  do  not  typically  perform  in  an  alert  manner  when  required 
to  search  for  extended  periods  of  time,  especially  when  the 
incidence  of  contacts  is  low.  The  result  of  this  is  that  sub¬ 
marines  may  go  undetected  for  longer  than  necessary  and  when 
detected  the  resultant  time  available  for  classification  and 
tracking  is  reduced- -possibly  to  an  extent  that  seriously  degrade 
the  ASW  system’s  performance.  Our  approach  to  the  solution  of 
this  problem  is  to  develop  a  computer  processing  system  which 
can  handle  the  vast  quantity  of  data  and  in  so  doing  operate  in  a 
near  optimum  manner  by  virtue  of  a  ping-to-ping  integration  and 
tracking  algorithm. 

Work  under  this  contract  has  produced  a  general  frame¬ 
work  for  a  computer  system  that  will  accept  and  analyze  this  vast 
quantity  of  data.  The  output  of  this  system  will  be  an  array  of 
alerting  function  values  that  measure  the  likelihood  that  a  target 
occupies  each  of  coordinate  positions  within  the  search  volume  of 
the  sonar.  Information  concerning  tie  target  track  is  stored  in 
the  computer  bank.  Toward  implementing  the  above  framework,  the 
present  study  has  developed  a  computer  processor  which  analyzes 
the  outputs  of  two  active  processors,  high-  and  low-Doppler,  and 
combines  the  results  into  a  single  output  channel  which  can  be 
used  for  decision  purposes.  Also  an  observer  study  to  measure 
the  performance  of  a  low-Doppler  SLR  processor  us~ng  sea  data  was 
carried  out.  An  SLR  processor  for  a  wideband  passive  sonar  was 
developed. 
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The  processing  is  Lased  on  Sequential  Likelihood 
Ratio  (SLR)  procedures  that  have  been  investigated  previously. 

Those  results  are  summarized  in  Appendix  A.  Briefly,  the  SLR 
processor  combines  a  statistical  decision  test  (Wald's  Sequential 
Probability  Ratio  Test)  and  a  basic  tracking  program.  The  tracking 
program  selects  target  tracks  that  have  motion  consistent  with  that 
of  a  submarine  and  the  SLR  test  is  used  to  decide  whether  the  track 
should  be  rejected  or  retained,  and,  if  retained,  possibly  dis¬ 
played.  The  testing  procedure  operates  much  like  an  alert  operator 
but  without  the  variability  of  an  operator  who  is  of  course  sus¬ 
ceptible  to  fatigue,  subjectivity,  boredom,  poor  training  and  a  host 
of  other  deterrents  to  ideal,  time -invariant  detection  performance. 
More  important  than  this  perhaps  is  the  fact  that  the  information 
handling  capacity  of  this  computer  process  is  far  in  excess  of 
that  of  the  operator  and  is  also  subject  to  expansion  as  computer 
technology  improves  whereas  the  capacity  of  the  operator  is  unlikely 
to  be  expanded  or  improved  by  any  significant  amount  in  spite  of 
advances  in  display  technology. 
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2.0  SUMMARY  OF  RESULTS 

Several  major  items  have  been  accomplished  during 
this  study.  These  were: 

1.  Development  of  a  general  framework  for  combining 
multiple  sonar  receiver  outputs  to  form  alerting  functions. 

2.  Extension  of  sequential  likelihood  ratio  (SLR) 
processing  to  three  dimensions—  range ,  bearing,  and  Doppler. 

3.  Combination  of  two  active  sonar  processed 
channel  outputs— low-  and  high-Doppler— in  an  SLR  algorithm. 

4.  Implementation  of  a  version  of  the  SLR  processor 
on  The  University  of  Texas  Applied  Research  Laboratory's  (ARL) 

CDC  3200  digital  computer 

5.  Development  of  a  mathematical  model  to  calculate 
the  probabilities  of  clutter  and  detection  in  the  SLR  processor. 

6.  Conducting  an  observer-display  study  using  ARL 
data  to  test  the  SLR  processor  with  sea  data. 

7.  Development  of  an  SLR  processor  for  the  output 
of  a  wideband  passive  sonar. 

The  primary  stops  for  combining  multiple  sonar 
receiver  outputs  include  SLR  processing  of  each  individual  signal 
processing  channel,  weighting  the  results  depending  on  expected 
processor  performance,  combining  channels  that  have  overlapping 
performance  envelopes,  e.g.,  wideband  bud  narrowband  passive 
processors,  and  choosing  the  maximum  output  among  the  individual 
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and  combined  processors.  Provisions  must  be  made  for  dimensionality 
mismatch  and  varying  resolution  cell  sizes.  The  multireceiver 
processor  is  described  in  detail  in  Section  3.0. 

The  SLR  multireceiver  processor  was  implemented  to 
simultaneously  process  multiple  active  sonar  receiver  outputs. 

In  particular,  a  sonar  system  consisting  of  both  low-Doppler 
(FM  replica  correlator)  and  high-Doppler  (CW  comb-filter  bank) 
receivers  was  assumed.  The  previously  developed  SLR  tracking  and 
detection  algorithm  which  employed  the  dimensions  of  range  and 
bearing  has  been  generalized  to  include  the  Doppler  dimension 
which  is  available  at  the  output  of  the  high-Doppler  receiver. 

In  implementing  the  high-Doppler  SLR  it  was  found  that  retaining 
only  the  maximum  amplitude  sample  associated  with  the  comb-filter 
bank  for  any  given  resolution  cell  gave  almost  equivalent  detection 
performance  and  required  64%  less  computer  space  than  retaining 
all  significant  samples.  The  development  of  the  two  single 
channel  SLR  processors  is  discussed  in  Section  4.0  of  a  previous 
report.* 

Based  on  the  general  framework,  a  processor  which 
combines  the  two  active  processor  outputs  was  developed  and  tested. 
It  was  found  that  the  combined  SLR  gave  better  performance  than 
either  single  channel  SLR  and  that  the  performance  of  the  combined 
SLR  was  more  consistent  across  the  range  of  Doppler  shifts  than 
was  each  individual  processor.  This  was  true  even  for  the  range 
of  Doppler  shifts  where  the  performance  of  both  processors  was 
degraded.  The  details  of  this  study  are  given  in  Section  5.0  of 
the  above  mentioned  report. 

The  output  of  ARL's  digital  sonar  was  processed  with 
an  SLR  processor  developed  for  the  ARL  CDC  3200  computer.  This 

*Reeder,  H.  A.,  ''Simultaneous  Likelihood  Ratio  Processing  for 
Two  Active  Receivers,"  TRACOR  Document  T71-AU-9594-U,  Vol.  I, 

25  August  1971. 
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version  operates  on  amplitude  samples  indexed  by  rc.nge  and  bearing. 
In  order  to  efficiently  use  the  smaller,  less  sophisticated  machine, 
this  new  SLR  processor  differs  substantially  in  details  from  the 
TRACOR  UNIVAC  1108  computer  version.  However,  the  final  results 
of  the  two  programs,  operating  on  the  same  data,  are  identical. 

This  program  is  discussed  in  Section  4.0. 

The  mathematical  model  of  the  SLR  processor  clutter 
and  detection  probabilities  makes  possible  the  easy  and  economical 
study  of  the  effects  of  parameter  changes  in  the  processor.  The 
model  and  one  such  study  are  discussed  in  Section  4.3  of  TRACOR 
Document  T71-AU-9594-U.  The  parameter  study  indicates  that  the 
greatest  gains  in  individual  SLR  processor  performance  may  be 
accomplished  by  making  the  SLR  tracking  algorithm  more  selective — 
i.e.,  reducing  the  ping-to-ping  tracking  errors. 

The  ARL  data  used  in  the  observer  display  study 
were  recorded  AN/SQS-23  stave  data  with  injected  target  signals. 
These  data  were  digitally  beamforraed  by  ARL,  envelope  detected, 
and  integrated.  Local  peaks  in  bearing  and  range  were  retained 
and  a  mean  and  standard  deviation  of  the  local  noise  field  calcu¬ 
lated.  These  latter  statistics  were  used  to  normalize  the  peak 
amplitude  values.  It  was  found  that  some  data  runs  exhibited  noise 
spokes  that  interfered  with  SLR  processing.  Ways  to  partly 
suppress  these  spokes  were  implemented.  The  first  twelve  injected 
targets  simulated  straight  line  motion  and  the  signal-to-noise 
ratio  was  increased  2  dB  every  five  pings.  The  last  run  was  a 
maneuvering  target  with  constant  signal-to-noise  ratio.  These 
data  were  analyzed  by  the  SLR  processor  implemented  on  the  ARL 
CDC  3200  computer.  The  SLR  and  non-SLR  processed  data  were 
analyzed  and  compared,  first  analytically,  then  with  observer 
responses.  It  was  found  analytically  that  the  SLR  processed  data 
crossed  decision  thresholds  sooner  and  therefore  at  lower  signal- 
to-noise  ratios.  However,  the  observer  responses  showed  no 
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statistically  significant  differences  between  the  SLR  and  non-SLR 
processed  data  for  the  limited  data  base  available  for  the  test. 

One  possible  reason  for  this  is  the  fact  that  the 
signal-to-noise  ratio  increased  periodically  and  the  probability 
of  marking  the  display  for  both  SLR  and  non-SLR  processed  data 
went  from  low  to  high  in  a  short  time  period.  This  "bang -bang” 
effect  masks  the  ability  of  the  SLR  processor  to  integrate  and 
enhance  small  signal-to-noise  ratio  signals.  Also,  the  display 
study  utilized  alerted  observers  who  were  not  subjected  to  the 
fatigue  of  long  watches  with  low  incidence  of  a  target.  This  factor 
would  be  difficult  to  reproduce  in  the  laboratory.  Finally,  the 
data  base  consisted  of  only  13  independent  runs.  With  such  a  small 
data  base,  only  gross  differences  will  show  statistically  signifi¬ 
cant  differences.  The  results  of  this  study  are  given  in  Section  5.0. 

The  SLR  processor  was  adapted  to  the  output  of  a 
wideband  passive  receiver.  The  results  for  simulated  data  show 
an  improvement  in  the  form  of  reduced  input  signal-to-noise  ratio 
to  achieve  0.5  probability  of  detection  at  a  set  false  alarm 
probability.  The  results  or  this  study  are  reported  separately.* 


*Reeder,  H.  A.,  "Computer  Aided  Detection 
Sonar  Systems,"  TRACOR  Document  T73-AU-9520-U, 


for  Wideband  Passive 
14  February  1973. 
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FRAMEWORK  FOR  INCLUSION  OF  MULTIPLE  SONAR  RECEIVER 
OUTPUTS  IN  SLR  PROCESSING 

3. 3  Formation  of  Multireceiver  Joint  Likelihood 

Ratios--Alerting  Functions 

The  objective  of  this  section  is  to  develop  a  multi¬ 
channel  alerting  algorithm  for  various  input  channels  as  well  as 
high-  and  low-Doppler  active  search  receiver  outputs.  Sequential 
likelihood  ratio  tracking  of  active  receiver  outputs  is  the  subject 
of  a  present  contract.  It  is  assumed  that  each  separate  channel 
has  been  subjected  to  a  sequential  likelihood  ratio  process  that 
yields  a  likelihood  ratio  for  each  resolution  cell.  For  purposes 
of  illustration  four  processors  will  be  considered:  a  low-Doppler 
processor  whose  output  is  indexed  by  range  and  bearing;  a  high- 
Doppler  processor,  indexed  by  range,  bearing,  and  Doppler  shift;  a 
wideband  passive  processor,  indexed  by  bearing;  and  a  narrowband 
passive  rece.^er,  indexed  by  bearing  and  line  frequency.  These 
four  processors  demonstrate  a  variety  of  situations  inherent  in 
combining  likelihood  ratios  with  different  dimensionality  and 
resolution  cell  sizes. 

When  all  of  the  SLR  ping- to- ping  tracking  is 
accomplished  on  each  receiver  output,  there  will  exist  the  informa¬ 
tion  shown  in  Fig.  3-1.  For  convenience,  this  figure  shows  the 
processed  data  in  a  continuous  and  unthresholded  form,  although  in 
reality,  each  output  is  sampled  and  ^hresholded  so  that  the  actual 
quantity  of  data  will  be  less  than  that  shown.  The  task  before  u,*- 
now  .'.8  tq  adopt  a  method  for  combining  these  outputs  to  form  a 
measure  of  the  likelihood  that  a  target  occupies  a  given  range-bearing 
cell.  This  will  be  approached  by  first  combining  the  two  processed 
active  outputs,  then  (conceptually)  combining  the  two  passive 
system  outputs  and  finally  (again  conceptually)  combining  the 
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(d)  -  Passive  Narrowband  SLR  Processed  Output 


(c)  -  Passive  Wideband  SLR  Processed  Output 
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(b)  -  Active  Low-Doppler  SLR  Processed  Output 


FIG.  3-1  -  REPRESENTATIONS  OF  THE  SLR  PROCESSED  ACTIVE 

AND  PASSIVE  RECEIVER  OUTPUTS 
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joint  active  and  passive  outputs.  The  general  idea  here  is  to 
first  combine  those  processors  that  are  most  similar  in  processed 
data  form  and  then  combine  the  results  of  these  combinations. 


In  combining  the  outputs  of  two  or  more  processors 
we  face  problems  related  to  different  resolution  cell  size  and 
dimension  mismatch.  For  example,  in  the  active  high-  and  low- 
Doppler  receivers  we  have  tracks  developing  in  the  range,  bearing 
and  Doppler  dimensions  of  the  former  while  tracks  in  the  latter 
develop  in  only  the  range  and  bearing  dimensions.  In  addition,  it 
is  possible  to  have  a  range  cell  size  mismatch  between  these  two 
processor  outputs  since  resolution  in  the  low- Doppler  receiver  is 
determined  by  the  coded  pulse  bandwidth  while  range  resolution  in 
the  high- Doppler  receiver  is  determined  by  the  duration  of  a 
long  CW  pulse.  These  differences  are  depicted  in  Figs.  3-la 
and  3-lb  where  in  the  case  of  the  high-Doppler  output  the 
ordinate  is  described  by  a  pair  of  numbers,  one  giving  the  track 
likelihood  ratio,  the  other  giving  the  associated  Doppler.  Clearly, 
for  any  given  range-bearing  cell  in  the  high-Doppler  system  there 
can  be  more  than  one  (likelihood  ratio,  Doppler)  pair  since  track¬ 
ing  is  occurring  in  the  Doppler  dimension.  To  reduce  the  dimension¬ 
ality  to  the  range-bearing  dimensions,  the  computer  will  retain 
only  the  maximum  likelihood  ratio  (and  its  associated  Doppler)  in 
each  range-bearing  cell.  This  eliminates  the  problem  of  equalizing 
the  dimensionality  between  the  two  active  systems. 


3.1.1  Combination  of  Low-  and  High-Doppler  Active  System 

Outputs  -  The  next  problem  is  one  of  mismatch  between  resolution 
cell  size.  Figure  3-2  shows  a  representation  of  the  outputs  of 
the  SLR  processed  high-  and  low-Doppler  active  systems  from 


preformed  beams  steered  in  the  same  direction.  The  outputs  have 
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been  time  delayed  as  necessary  so  that  each  time  resolution  cell 
covers  the  same  range.  The  output  from  the  low-Doppler  SLR 
processor  has  been  serially  OR-ed  over  a  range  gate  corresponding 
to  the  approximate  length  of  a  target  or  a  display  resolution  cell. 
This  is  done  because  eventually  the  output  of  the  combined  SLR 
must  be  matched  to  a  display  for  presentation  and  the  serial  OR  at 
this  point  reduces  subsequent  processing  with  almost  no  degradation 
in  performance.  In  any  case  the  low-  and  high-Doppler  outputs  are 
combined  as  shown  in  Fig.  3-2.  This  figure  shows  that  in  the  low- 
Doppler  system  three  threshold  exceedings  have  occurred  during 
the  echo  cycle  shown.  Each  of  these  events  precipitates  a  check 
for  a  threshold  exceeding  event  in  the  high-Doppler  SLR  processed 
system  output  within  high-Doppler  range  resolution  cells  which 
encompass  the  range  cell  containing  the  low- Doppler  event.  If 
threshold  exceedings  do  not  occur  on  both  system  outputs  within  a 
common  high-Doppler  range  cell,  then  no  track  linkage  is  made 
during  the  echo  cycle  under  consideration.  In  this  way  the  SLR 
processed  data  from  both  active  receivers  is  combined  into  a 
common  measure  of  the  likelihood  of  target. 


3.1.2  Combination  of  Wideband  and  Narrowband  Passive 

System  Outputs  -  It  is  desirable  to  find  a  single  quantity  which 
represents  both  channels  of  passive  information,  or,  more  generally, 
a  quantity  that  represents  the  likelihood  of  a  target  being  on  a 
particular  bearing  only.  The  first  problem  faced  in  finding  a 
joint  measure  of  passive  information  is  a  dimensionality  mismatch. 
For  any  given  time  the  narrowband  information  is  indexed  by 
frequency  and  bearing  while  the  wideband  information  is  indexed  by 
bearing  only.  Probably,  the  best  way  to  approach  this  problem  is 
to  adopt  the  same  procedure  as  in  the  active  case  and  reduce  the 
dimensionality  of  the  narrowband  data.  This  may  be  done  by  a 
Max-OR  or  summing  process.  The  summing  approach  would  consist  of 
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making  threshold  tests  on  the  spectral  outputs  of  each  beam  and 
then  slamming  those  frequency  channel  outputs  which  exceed  a 
threshold. 


Once  the  dimensionality  has  been  matched,  a  combina¬ 
tion  process  such  as  the  active  case  may  be  carried  out.  This 
involves  adding  log  likelihood  ratios  that  correspond  to  the  same 
bearing  resolution  cell  and  that  exceed  certain  thresholds.  The 
results  are  joint  log  likelihood  ratios  that  form  a  measure  that 
there  is  a  passively-detected  target  associated  with  that  bearing 
resolution  cell. 


3.1.3  Combination  of  Active  and  Passive  SLR  Processed 

Data  -  It  is  assumed  that  each  active  and  passive  beam  will 
have  a  joint  log  likelihood  ratio  as  a  function  of  time  associated 
with  it.  The  task  is  now  to  combine  active  and  passive  information. 
Since  each  information  channel  is  obtained  in  a  different  way  and 
in  separate  frequency  bands,  it  is  reasonable  to  assume  tentatively 
that  they  are  statistically  independent;  hence,  the  joint  active- 
passive  log  likelihood  ratio  is  just  the  sum  of  the  two  individual 
log  likelihood  ratios.  The  essential  problem  in  this  case  is  the 
dimensionality  mismatch  mentioned  previously.  The  passive  informa¬ 
tion  is  indexed  by  bearing  and  time  only  while  the  active  is 
indexed  by  range,  bearing  and  time. 

Recall  from  Fig.  3-1  that  for  the  passive  systems  we 
have  log  likelihood  ratios  indexed  by  bearing  and  time.  This  means 
that  when  the  joint  log  likelihood  ratios  are  formed,  we  will  have 
for  the  passive  receivers  a  single  measure  of  the  likelihood  of 
target  for  each  resolvable  bearing  and  at  each  instant  of  time. 
Similarly,  for  the  active  systems  we  will  have  a  set  of  joint  log 
likelihood  ratios  indexed  by  range,  bearing,  and  time  or  ping 
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number.  These  arrays  of  numbers  are  shown  diagrammatically  in 
Fig.  3-3.  This  figure  shows  the  output  of  the  joint  SLR  processed 
passive  data  which  exists  at  time  Ap  as  well  as  the  joint  SLR 
processed  active  data  during  a  ping  cycle  which  exists  over  a  time 
period  that  encompasses  the  time  Since  no  range  information  is 

currently  available  from  the  passive  search  system,  the  selected 
active  joint  log  likelihood  ratios  will  be  enhanced  by  summing 
them  with  the  last  available  and  relevant  passive  log  likelihood 
ratios  that  occur  on  the  same  bearing.  By  "selected"  we  mean  that 
a  threshold  test  would  be  applied  to  the  active  data  before  linking 
to  it  the  thresholded  passive  data.  The  levels  at  which  these 
thresholds  will  ultimately  be  set  will  depend  upon  the  available 
computer  capacity.  That  is,  ideally  it  would  be  desirable  to 
perform  no  thresholding  until  all  of  the  joint  active  and  passive 
log  likelihood  ratios  have  been  formed.  However,  from  a  realistic 
viewpoint  there  must  be  the  capability  for  reducing  the  amount  of 
data  stored  in  the  shipboard  computer. 

The  computer  algorithm  which  will  perform  sequential 
likelihood  ratio  tracking  and  joint  log  likelihood  ratio  formation 
on  the  outputs  of  active  high-  and  low-Doppler  and  passive  narrow- 
band  and  wideband  outputs  is  shown  in  block  diagram  form  in  Fig.  3-4. 

This  figure  shows  each  of  the  active  and  passive  SLR 
processed  outputs  being  applied  to  threshold  circuits  and  then 
to  weighting  circuits.  The  purpose  of  the  threshold  circuits  is 
primarily  to  control  computer  loading.  This  will  be  accomplished 
in  the  following  manner.  The  outputs  of  each  of  the  SLR  processors 
shown  in  Fig.  3-4  will  be  unthresholded  tracks  and  thus  will  con¬ 
tain  numerous  spurious  noise  tracks.  Ideally,  we  would  prefer  to 
defer  any  decision  with  regard  to  threshold  as  late  in  the  process¬ 
ing  as  possible  so  that  low  signal-to-noise  ratio  tracks  will  be 
enhanced  as  much  as  possible  by  the  process  of  joint  tracking  and 
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likelihood  ratio  formation.  However,  it  will  be  necessary  to 
provide  a  means  of  controlling  the  number  of  tracks  so  that  the 
computer  storage  capacity  is  not  exceeded.  This  then  is  the 
function  of  the  adjustable  thresholds  shown  in  Fig.  3-4. 

The  thresholded  data  are  then  passed  to  circuits 
which  weight  the  log  likelihood  ratios  according  to  a  predicted 

performance  envelope.  The  weighting  of  the  SLR  processed  output 
of  each  sonar  receiver  is  necessary.  When  one  can  predict 
that  a  certain  processor  will  not  perform  beyond  a  certain 
range  under  a  specific  set  of  conditions,  then  it  is  obvious 
that  the  inclusion  of  that  processor's  output  in  the  final 
joint  log  likelihood  ratio  will  only  serve  to  degrade  otherwise 
potentially  sound  tracks.  As  an  example  of  this  use  of  weightings 
consider  the  situation  where  the  speed  of  a  given  track  in  the 
active  systems  is  estimated  to  be  near  zero.  There  are  other  con¬ 
ditions  such  as  own  ship  speed,  sea  state,  and  propagation  loss 
which  when  combined  with  sufficiently  low  target  speed  would 
result  in  a  very  low  probability  of  threshold  crossing  in  the 
passive  wideband  receiver  at  all  but  very  small  target  ranges. 

Such  a  prediction  will  of  course  require  that  one  assume  some 
radiated  spectrum  level  versus  speed  function  for  the  potential 
target.  This  may  be  accomplished  by  considering  those  enemy 
submarines  of  interest  which  exhibit  the  highest  radiated  noise 
level  as  a  function  of  speed  and  obtaining  an  average  relationship 
for  these  targets  to  be  used  as  input  to  the  performance  prediction 
subroutine.  This  approach  will  result  in  a  maximum  average 
detection  envelope  and  thus  will  result  in  weightings  for  the 
wideband  passive  system  output  which  will  ensure  (statistically) 
that  all  targets  of  interest  will  be  processed.  When  in  error, 
as  for  example  when  a  quieter  submarine  is  actually  present,  the 
overall  log  likelihood  ratios  will  suffer  some  degradation  as  a 
result  of  the  conservative  manner  in  which  weightings  are  derived. 
However,  the  individual  receiver  log  likelihood  ratios  will  not  be 
degraded. 
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These  weights  will,  without  any  other  data  available, 
be  either  zero  or  one,  and  will  be  indexed  by  range  and  bearing 
angle.  Fig,  3-5  shows  an  example  of  the  weighting  function  for 
the  wideband  passive  system  as  well  as  the  manner  in  which  it  is 
derived.  As  shown  in  this  figure,  the  probability  of  exceeding 
threshold  as  a  function  of  range  is  used  to  determine  some 
performance  threshold  and  hence  a  maximum  performance  range 
This  information  is  used  to  form  the  weighting  function  which 
acts,  in  fact,  as  a  performance  envelope  gate  for  the  data 
emerging  from  each  channel  of  the  multireceiver  system. 


At  the  output  of  the  weighting  circuits  the  four 
channels  of  data  are  combined  not  only  into  active  and  passive  joint 
log  likelihood  ratios  and  a  joint  active/passive  log  likelihood  ratio 
but  also  in  various  other  ways.  Namely,  in  addition  to  the  joint 
log  likelihood  ratios  just  mentioned,  the  individual  log  likeli¬ 
hood  ratios  are  preserved  separately  as  well  as  combined  into  other 
joint  functions.  Specifically,  the  joint  log  likelihood  ratios 
may  be  based  on  passive  wideband  and  active  high-Doppler  outputs 
as  well  as  passive  narrowband  and  active  low-Doppler  outputs.  In 
this  way  the  system  consists  of  nine  different  channels  of  output 
SLR  data. 


Consider  for  a  moment  the  reasons  for  producing  an 
output  of  this  type.  To  begin  with,  if  we  could  predict  exactly 
for  a  given  target  and  environment,  the  performance  envelope  of 
each  of  the  four  receivers  and  thus  quite  accurately  accept  or 
reject  those  receiver  outputs  which  should  or  should  not  contribute 
constructively  to  the  overall  joint  log  likelihood  ratio,  then 
there  would  be  no  need  for  a  multichannel  output.  To  some  extent 
we  can  do  this--in  particular  according  to  the  weighting  mechanism 
described  earlier.  However,  it  is  not  possible  to  forecast  a  priori 
the  exact  performance  envelope  for  every  target  type  and  environment 
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and  then  select  the  proper  envelope  and  weight.  Since  we  have 
chosen  to  use  performance  envelopes  based  on  best  case  character¬ 
istics  (e.g.,  a  noisy  target)  there  will  arise  cases  where  a 
receiver  has  no  chance  of  detecting  the  target  even  though  the 
weight  is  equal  to  unity  (e.g.,  a  very  quiet  target).  In  this 
instance  the  wideband  passive  receiver  will  contribute  essentially 
a  noisy  output  to  the  joint  likelihood  ratio.  In  general  there 
may  very  well  be  cases  where  one  channel  by  itself  could  cause  an 
alarm  but  when  combined  with  other  nonperforming,  noisy  channels 
of  data,  the  chance  to  detect  is  lost.  This  possibility  can  be 
dealt  with  by  allowing  each  channel  to  generate  an  alarm  on  its 
own. 


Actually,  the  situation  we  have  here  is  quite  analo 
gous  to  the  problem  of  detecting  a  narrowband  signal  in  a  wideband 
noise  background  when  the  carrier  frequency  of  the  signal  is  not 
known  a  priori. 

It  is  known  that  the  optimum  approach  to  detecting 
this  signal  is  to  design  a  bank  of  contiguous  filters,  each  having 
a  center  frequency  which  the  signal  carrier  frequency  may  condi- 
tionally  take  on.  Thus  each  channel  of  this  system  is  optimum 
for  detecting  the  signal  under  the  condition  that  the  carrier 
frequency  of  the  signal  is  equal  to  the  center  frequency  of  the 
channel.  The  remaining  part  of  the  processing  in  this  case  is 
to  select  the  filter  output  whose  likelihood  ratio  is  maximum. 

By  analogy  then  we  can  view  our  multichannel  system  as  consisting 
of  several  channels  each  of  which  is  optimum  under  some  condition 
which  cannot  be  predetermined.  That  is  to  say,  if  the  performance 
curves  of  each  of  the  four  input  channels  overlap  for  some  set  of 

E-  J.  Kelly,  I.  S.  Reed,  and  W.  L.  Root,  "Detection  of  Radar 
Echoes  in  Noise  I."  Journal  of  the  Society  of  Industrial  Applied 
Mathematics,  pp  309 -341,  Vol.  8,  No .  2,  June  I9(>0 . 
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conditions,  then  the  overall  joint  active/passive  log  likelihood 
ratio  channel  will  be  the  optimum  channel  and  will  control  the 
output  of  the  OR-gate  shown  in  Fig.  3-4.  If  on  the  other  hand, 
the  target  is  a  high  speed,  bow  aspect  target  such  that  these 
and  other  conditions  render  the  active  high-Doppler  and  passive 
wideband  combination  optimum,  then  this  channel  will  dominate 
the  OR-gate  output  and  lead  to  alerting  functions. 

The  price  that  is  paid  by  taking  this  approach  is  of 
course  an  increased  number  of  opportunities  to  false  alarm  which 
can  be  compensated  for  by  increased  thresholds  which  in  turn 
leads  to  some  decrease  in  detection  capability.  However, 
theoretical  considerations  indicate  that  there  will  be  a  net 
gain  by  this  approach. 

It  will  be  recognized  in  Fig.  3-4  that  not  all  combina¬ 
tions  of  the  four  receiver  outputs  are  considered.  There  are  in 
fact  fifteen  different  combinations  which  could  be  formed  from 
the  original  four  channels  of  data.  We  have  selected  certain 
channels  which  appear  reasonable.  That  is,  we  have  the  overall 
joint  active /passive  channel  which  will  be  optimum  when  all  per¬ 
formance  curves  overlap.  There  are  also  the  individual  log 
likelihood  ratio  channels,  one  of  which  can  produce  an  alarm 
should  the  other  three  channels  be  inoperable  by  virtue  of 
constructed  performance  envelopes.  The  combination  of  both  passive 
channels  results  in  a  detection  channel  which  should  be  effective 
against  torpedoes  where  active  receiver  performance  is  seriously 
degraded  by  small  target  strengths.  The  combined  active  channels 
are  effective  against  a  deep,  quiet  submarine  running  at  a  speed 
greater  than  zero  knots  but  just  below  the  cavitation  inception 
speed.  The  combination  of  active  high-Doppler  and  passive  wideband 
is  a  reasonable  choice  for  a  high  speed  sub,  while  the  combination 
of  active  low-Doppler  and  passive  narrowband  receiver  outputs  may 
be  the  optimum  means  of  detecting  a  very  low  speed  sub. 
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What  must  be  established  is  the  performance  of 
different  configurations  of  the  automatic  alerting  system  under 
a  variety  of  input  conditions  which  represent  real  world  situations. 
This  is  necessary  so  that  we  can  make  an  intelligent  choice  of  a 
single  configuration  with  respect  to  both  detection  performance 
and  computer  requirements. 
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It  is  desirable  to  verify  the  performance  gains 
obtainable  with  SLR  processing  using  sea  data.  However,  multibeam 
sea  data  has  not  previously  been  conveniently  and  economically 
available.  The  Applied  Research  Laboratory  of  The  University  of 
Texas  (ARL)  has  not  implemented  a  digital  sonar  that  processes 
stave  recordings  through  a  digital  beamformer  and  a  signal  processor. 
To  operat  within  funding  constraints  the  SLR  processor  was  imple¬ 
mented  on  ARL’s  CDC  3200  digital  computer.  This  implementation 
was  also  a  useful  test  of  the  adaptability  of  the  SLR  processor  to, 
a  smaller,  less  sophisticated  machine. 

4,2  Implementation  of  SLR  Processor 

ARL's  digital  sonar  furnishes  one  channel  of 
amplitude  samples  that  are  indexed  by  range  and  bearing.  Since  there 
is  no  Doppler  information  or  separate  high-Doppler  channel,  the 
techniques  developed  during  the  present  contract  were  not  used 
in  this  SLR  processor.  The  logical  structure  of  the  low-Dopplcr 
SLR  processor  was  used  without  change.  The  program  receives 
incoming  data  samples,  compares  them  with  previously  stored 
tracks  to  form  possible  tracks,  calculates  joint  log  likelihood 
ratios,  and  makes  statistically  significant  decisions. 

The  major  required  modifications  concerned  the 
technical  implementation  of  the  logical  structure  into  a  computer 
code.  In  order  to  understand  why  these  changes  were  necessary,  it 
is  instructive  to  review  some  of  relevant  facts  about  TRACOR' s 
UN1VAC  1108  computer  and  ARL's  CDC  3200  computer.  The  1108  is  a 
large  storage  machine  with  a  sophisticated  compiler,  while  the 
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3200  is  a  medium  storage  machine  with  a  good,  but  less  efficient 
compiler.  The  1108  is  faster  in  execution  of  programs. 

In  development  of  the  SLR  processor  the  flexibility 
and  large  storage  capacity  of  the  UNIVAC  1108  has  been  used 
extensively.  The  TRACOR  program  consists  of  a  number  of 
subroutines,  each  accomplishing  specialized  tasks.  While  this 
sacrifices  some  program  efficiency,  it  allows  flexible  programing 
and  the  easy  incorporation  of  newly  developed  procedures.  For 
the  3200  implementation,  greater  efficiency  and  compactness  was 
achieved  by  rewriting  the  SLR  processor.  The  revised  version 
consists  of  one  large  program  of  in-line  code  and  three  short 
subroutines  that  contain  code  that  is  repeated  in  several 
places  in  the  main  program.  Where  possible,  flexibility  to  expand 
to  more  dimensions  was  incorporated;  however,  this  expansion  is 
not  as  easy  as  with  the  TRACOR  program. 

Another  machine  difference  dictated  reformatting  the 
log  likelihood  ratio  associated  with  each  track  as  well  as 
several  processor  parameters.  The  3200  requires  two  core  storage 
words  to  accommodate  a  decimal  representation  of  a  real  number, 
while  the  1108  requires  only  one.  Since  a  joint  log  likelihood 
ratio  is  a  decimal  number  and  must  be  stored  for  each  track  held 
in  core  storage,  doubling  the  required  storage  would  increase 
storage  requirements  considerably.  Integer  numbers  require  only 
one  word  of  storage  in  the  3200;  therefore,  the  joint  log  likelihood 
ratios  are  multiplied  by  a  scale  factor  and  translated  to  an 
integer  prior  to  storage.  Most  decimal  parameters  are  treated  in 
a  similar  manner. 

A  description  of  the  program  and  its  required 
Inputs  is  given  in  Appendix  B  as  well  as  a  complete  listing  and 
flow  chart. 
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Description  of  ARL'a  Data  Processing 


ARL's  digital  sonar  consists  of  recorded  stave 
outputs,  a  digital  beamfonner,  an  envelope  detector  and  an 
Integrator  for  each  fixed  beam.  In  addition,  a  general  purpose 
digital  computer  further  processes  the  data  by  calculating  the 
mean,  standard  deviation  and  median  of  the  samples  contained  in 
an  annulus  centered  around  each  sample  in  the  sonar  output  array. 
If  the  sample  divided  by  the  mean  of  the  data  in  the  annulus 
(this  is,  a  normalized  sample)  is  less  than  a  specified  threshold, 
•for  example  1,  or  if  the  sample  is  less  than  any  of  the  samples 
contained  in  adjacent  range  and  bearing  location  it  is 
rejected.  The  end  result  of  the  above  processing  is  a  reduced 
number  of  samples  that  are  local  peaks  and  which  exceed  a  certain 
threshold. 


TRACOR' s  mathematical  model  of  ARL's  system  output 
assumes  Gaussian  statistics  out  of  the  beamformer.  This  implies 
that  the  envelope  detector  yields  Rayleigh-Rice  statistics  for  signal- 
plus-noise  samples  and  Rayleigh  statistics  for  noise-only  samples. 
Using  this  result,  the  statistics  at  the  output  of  the  integrator  may 
be  found  by  an  appropriate  number  of  convolutions  of  the  above  density 
function.  To  account  for  the  normalization  process,  i.e., 
dividing  one  random  variable  by  another,  the  density  function  of 
the  ratio  of  the  data  sample  to  the  mean  of  the  annulus  was  found 
by  numerical  integration.  Although  the  above  process  closely 
models  the  physical  processor,  it  was  found  that  the  computed 
results  do  not  fit  the  observed  data  for  any  bandwidth-averaging 
time  (0r)  product  between  1  and  13  (which  is  the  range  of 
variation  of  £5t  as  the  data  varies  from  reverberation  to  noise 
limited  condition).  That  is,  if  the  data  were  from  a  ping  cycle 
in  which  a  CW  signal  had  been  transmitted,  then  one  would  expect 
the  {3t  product  to  range  from  1  (reverberation  limited  data)  to  13, 
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(ftdise  limited  data).  Since  linearly  frequency  modulated  pulses  were 
used  to  generate  this  data,  the  Bt  product  should  not  vary  unless 
the  passband  of  the  receiver  does  not  match  the  frequency  band  of 
the  signal.  The  observed  deviation  may  be  caused  by  several 
factors,  such  as  variation  of  envelope  statistics  caused  by  the 
approximate  envelope  detector  used  in  the  ARL  digital  sonar, 
variation  in  the  assumed  Gaussian  input  statistics  due  to  at-sea 
conditions,  round-off  errors  in  the  numerical  calculations 
involved  in  the  model,  passband  variations  in  the  receiver,  and 
data  quantization  in  ARL's  digital  sonar  (the  above  model  assumes 
no  quantization  of  input  data).  Nevertheless,  by  averaging  the 
probability  distributions  for  Bt  products  of  1  through  13  a  cio3e 

approximation  to  the  observed  distribution  was  obtained,  as  is 

* 

shown- in  Fig.  4-1. 


4.4  Derivation  of  Log  Likelihood  Ratio 

4.4.1  Development  of  the  Model  for  Output  Statistics  - 

The  model  is  based  on  a  step  by  step  transformation  of  the  input 
statistics.  It  is  assumed  that  the  output  of  beamformer  is  Gaussianly 
distributed  when  noise  alone  is  present  and  is  Gaussian  plus  a  sine 
wave  for  signal  plus  noise.  The  bandwidth  of  the  data  is  approxi¬ 
mately  400  Hz.  It  is  well  known  that  the  envelope  of  the  assumed 
wave  form  is  distributed  as  a  Rayleigh-Rice  random  variable, 


f(x)  »  j-  exp 


where 


2  2 
x*  4  a 


I  (2S) 
o  \ } 


(4-1) 


♦0  -  noise  power  prior  to  envelope  detection 
a  »  the  peak  amplitude  of  the  signal. 


For  mathematical  simplicity  it  is  assumed  that  is  identically  1. 
If  a  is  zero  then  noise  alone  is  present  and  Eq.  (4-1)  reduces 
to  the  familiar  Rayleigh  density. 
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FIG.  4-1  - 


Threshold 

COMPARISON  OF  THE  PROBABILITY  OF  EXCEEDING 
THRESHOLD  VS  THRESHOLD  FOR  ARL'S  OBSERVED  DATA 
(SOLID)  AND  TRACOR  CALCULATED  RESULTS  (DASHED) 


(4-2) 
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f(x)  -  x  exp(-x^/2) 

Equations  (4-1)  and  (4-2)  give  the  statistics  of  signal-plus-noise 
after  envelope  detection. 

The  signal  is  30  ms  long  and  the  digital  sonar 
integrates  for  32  ms.  If  at  any  point  in  time  the  0t  product 
is  equal  to  N,  then  N  independent  envelope  samples  are  being 
summed.  The  density  of  these  samples  may  be  found  by  convolving 
the  signal-plus-noise  or  noise-alone  density  N  times.  The 
complicated  structure  of  Eqs.  (4-1)  and  (4-2)  preclude  carrying 
out  the  convolutions  in  closed  form  if  N  is  even  moderately 
large.  The  convolutions  were  accomplished  by  making  a  discrete 
approximation  to  Eqs.  (4*>1)  and  (4-2)  and  then  taking  the 
inverse  discrete  Fourier  transform  with  an  FFT  algorithm  to  form 
an  approximation  to  their  characteristic  function.  It  was  then 
possible  to  raise  the  characteristic  functions  to  the  power  N 
yielding  the  characteristic  function  of  the  N-fold  convolution 
of  Eqs.  (4-1)  and  (4-2),  The  required  density  function  was 
determined  by  taking  the  discrete  Fourier  transform  of  the 
calculated  characteristic  function.  The  RMS  error  of  the  above 

*  7^ 

process  is  about  1.5  x  10  ,  This  is  good  over  most  of  the 

range  of  the  density  function  but  leaves  much  to  be  desired  in 
the  tail  of  the  distribution  where  probabilities  are  of  the  same 
order  of  magnitude  as.  the  RMS  error.  To  overcome  the  problem, 
the  Edgeworth  expansion  of  the  sum  N-  variates  distributed 


James  F.  Ferrie,  et  al,  "Comparison  of  Four  Fast  Fourier 
Transform  Algorithms,"  Naval  Underwater  Systems  Center,  Newport, 
Rhode  Island,  3  June  1971. 
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M.  G.  Kendall  and  A.  Stuart,  "The  Advanced  Theory  of 
Statistics,"  Vol.  I,  Hafner,  New  York  (1963)  pp.  157-160. 
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according  to  Eqs.  (4-1)  and  (4-2)  was  found.  This  asyraptopic 
expansion  was  found  to  be  quite  good  for  very  small  values  of  N 
and  was  used  in  the  later  numerical  integration  routines.  The 
Edgeworth  expansion  is  basically  a  normal  approximation  to  the 
distribution  of  the  sum,  but  contains  correction  terms  based  on 
the  higher  order  moments  of  the  original  density  function.  As  the 
number  of  random  variables  summed  increases,  the  correction  terms 
become  quite  small.  While  it  was  necessary  to  use  the  Edgeworth 
expansion  of  an  individual  averaged  output  sample,  the  Gaussian 
approximation  for  the  average  of  the  samples  in  annulus  was  quite 
good,  since  64*N  independent  Rayleigh-Rice  samples  had  been  added 
together.  Hence,  for  any  0t  product  the  density  functions  for 
the  output  sample  and/or  the  mean  of  the  annulus  around  it  were 
known. 


With  the  above  information  the  density  of  the  ratio 
of  the  sample  value,  x,  to  the  mean  of  the  samples  in  the  annulus, 
y,  may  be  calculated  by  considering 


P(t*T)  -  Pr  (~  <  T)  -  Pr  (x  <  Ty) 

“  I  J  f(x)  g(y)  dx  dy 
00 

co 

“  J  F(Ty)  g(y)  dy 

o  (4-3) 

where 

g(y)  is  the  density  function  of  the  mean 
of  annulus  (assumed  to  be  Gaussian  for 
this  study) , 
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and  f(x)  is  given  by  Eq.  (4-1)  or  Eq.  (4-2)  for  signal -plus -noise 
or  noise  alone,  respectively.  Regarding  density,  p(T) ,  of  the 
ratio  T  =  -  is  given  by 

y 


P(T)  «dS  (Pr  (*  <  T))  -  j  yf(Ty)  g(y)  dy. 
j  o 


(4-4) 


Equations  (4-3)  and  (4-4)  were  calculated  for  a 
number  of  different  values  of  T  by  numerical  integration.  The 
density  of  the  ratio  T  was  tabulated  for  a  number  of  different 
signal- to- noise  ratios  and  for  Bt  products  from  1  to  13  in 
integer  steps.  Some  problems  were  encountered  in  calculating 
the  density  function  for  the  ratio  T  at  higher  values  where  the 
function  values  are  very  small  and  roundoff  error  became  important. 

The  final  step  n  the  process  is  choosing  only 
local  peaks;  that  is,  only  the  samples  whose  ratio  exceeds  those 
ratios  associated  with  eight  adjacent  range  and  bearing  resolution 
cells.  If  fg  ^  (x,a)  is  the  density  of  the  ratio  for  signal- 

plus-noise  and  f^(x)  is  the  density  of  the  ratio  for  noise  alone, 
then  the  required  probability,  PpR,  is 
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T  T 


Ppj^(x  ^  T)  *  ,  fg  ^  j^(x,a)  J  J  * 

T  -so  -so 


.  J  fN<x8)  dxg 

•  dx2  dx^  dx 


«0 

r 


8 


£s  +  u<*.a)  £u  (x)  <& 


(4-5) 


where 


Fjj(x)  is  noise  cumulative  distribution  of  the 

ratio 


For  signal-plus-noise  Eq,  (4-5)  may  be  determined  by  numerical 
means.  For  the -noise  along  case,  however,  Eq.  (4.-5)  becomes 


00 

PpK(x  >  T)  «  J  fs(x)  Fn8  (x)  dx 


“  \  fn9<t> 


(4-6) 


The  sonar  data  furnished  TRACOR  by  ARL  had  been 
subjected  to  peak  selection  and  was  conditioned  on  the  crossing 
of  a  threshold  on  the  ratio  of  about  1,2.  For  the  purpose  of 
data  comparison  this  complemented  conditional  probability  distribu¬ 
tion  was  calculated  and  is  given  by 


PR(x>T) 

PR(x  >  T  /  x  >1.2)  - - ,  T  a  1.2. 

PR(x>1.2) 
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Figure  4-2  gives  the  family  of  calculated  complemented  distribution 
functions  for  various  0t  products.  No  one  curve  fits  the  observed 
data.  However,  the  sorted  data  is  taken  from  all  parts  of  the  ping 
cycle.  The  conditions  are  changing  from  reverberation  limited  con¬ 
ditions,  0t»1,  to  noise  limited  conditions,  0tss13.  As  an  approxima¬ 
tion  to  the  ensemble  average  of  the  observed  data  the  distribution 
and  density  functions  for  S  v  products  of  1  through  13  were  averaged 
together.  The  results  were  shown  in  Fig.  4-1.  The  agreement  is 
very  good  except  at  the  lower  probabilities  where  the  previously 
mentioned  inaccuracies  in  the  numerical  integrations  and  approxima¬ 
tions  become  important.  Since  agreement  is  close  and  the 
mathematical  model  is  based  on  known  signal  processing  results, 
this  model  appears  to  be  very  adequate  for  noise  alone.  Unfortun¬ 
ately,  very  little  signal-plus-noise  data  is  available  for  analysis. 
Therefore ,  it  is  not  possible  to  validate  the  signal-plus-noise 
part  of  the  model.  It  should  be  pointed  out  that  it  depends  on 
the  same  reasonable  assumptions  and  that  the  SLR  processor  is 
reasonably  insensitive  to  variations  in  assumed  statistics,* 

Hence,  the  signal-plus-noise  part  of  the  model  should  be  good 
enough  for  the  purpose  of  generating  a  log  likelihood  ratio. 

4.4.2  Likelihood  Ratio  Equation  for  ARL*3  Output  -  The 

log  likelihood  ratio  is  defined  as 

L(x)  “  log  (ps  +  N(x)  /  pN  (x)  ), 

Using  the  derivatives  of  Eqs.  (4-5)  and  (4-6)  at  three  design 
signal -to-noise  ratios  of  6.  9,  and  12  dB,  the  log  likeli¬ 
hood  ratio  curves  were  plotted  for  the  average  of  the  various 
0 1  products.  The  behavior  of  the  curves  near  1  or  4  is  suspect 


*Reeder,  H.  A.,  "Final  Report,  Simultaneous  Likelihood  Ratio 
Processing  for  Two  Active  Receivers,"  Vol.  1,  TRACOR  Document 
T71-AU-9594-U,  25  August  1971. 
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FIG.  4-2  -  PROBABILITY  OF  EXCEEDING  THRESHOLD  VS  THRESHOLD 
FOR  8"  PRODUCTS  OF  1  THROUGH  13  (SOLID  LINES) 
AND  ARL*_>  OBSERVED -DATA  (DASHED)  _ 
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because  of  computer  round-off  errors;  however,  the  central  parts 
of  the  curves  are  believed  to  be  accurate.  The  results,  along 
with  a  straight  line  least  squares  fit  over  the  best  part  of  the 
curve,  are  plotted  in  Figs.  4-3,  4-4,  and  4-5.  The  straight  line 
fits  are  summarized  in  Table  4-1. 


TABLE  4-1 


STRAIGHT  LINE  LEAST  SQUARE  FITS  TO  AVERAGE  LOG  LIKELIHOOD  RATIO 


EQUATION 

Design  S/N 

Slope 

Intercept 

6  dB 

6.66 

-9.23 

9  dB 

9.34 

-15.40 

12  dB 

■■ 

7.56 

-15.32 

_ J 

The  9  dB  design  S/N  seems  to  be  the  most  reasonable  starting  place 
for  SLR  processing. 

The  model  as  derived  appears  to  be  reasonable;  however, 
its  accuracy  may  be  improved  by  the  expenditure  of  more  -time  and  money. 
For  instance,  by  including  more  terms  in  the  Edgeworth  expansion 
more  accuracy  may  be  produced  in  the  approximation.  By  extending 
the  numerical  integration  region  and  subdividing  it  more  finely 
greater  accuracy  may  be  obtained  (it  may  be  necessary  t<*  use 
double  precision  to  prevent  greater  round-off  error).  These  things 
would  require  greater  computer  expense  ss  well  as  some  re  programing. 
More  basic  is  the  assumption  of  Rayleigh-Rice.  statistics  rather  than 
a  fluctuating  target  model.  There  were  neither  time  nor  available 
funds  to  pursue  these  interesting  questions.  However,  it  is  felt 
the  present  results  are  entirely  adequate  for  the  determination  or 
an  approximation  to  the  log  likelihood  ratio  equation  for  the  SLR 
processor  for  the  ARL’s  digital  sonar  output. 
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4.5  Choice  Design  Signal-to-Noise  Ratio 

The  choice  of  a  design  signal-to-noise  ratio  is 
important  to  the  performance  of  the  SLR  processor.  Too  high 
a  value  will  cause  poor  detection  performance;  too  low  a  value 
will  cause  excessive  computer  loading.  In  the  previous  section 
the  derivation  of  the  log  likelihood  ratio  equations  for  three 
design  S/N  ratios  were  reported.  These  three  equations  were  used 
to  process  the  same  data  run  (ARL  run  number  4).  The  outputs  of 
these  runs  were  analyzed  as  well  as  the  non-SLR  data,  that  is, 
data  unchanged  from  the  ARL  digital  sonar.  In  each  case  the 
output  data  was  thresholded  at  four  levels  to  achieve  specified 
probabilities  of  false  alarm.  The  probabilities  chosen  correspond 
to  a  typical  modem  sonar  and  were  used  in  a  previous  SLR  study. 
The  measurements  on  the  data  include  the  ping  number  at  which  the 
target's  output  first  crossed  the  specified  threshold  giving  a 
measure  of  time  to  detect;  the  number  of  consecutive  pings  above 
the  threshold  after  the  first  crossing, which  indicates  whether  a 
detection  by  an  operator  is  likely  after  the  first  crossing;  and, 
finally,  the  total  number  of  times  the  target  output  exceeded  the 
threshold  out  of  50  ping  cycles.  The  tabulated  data,  Table  4- II, 
indicate  that  a  design  S/N  ratio  of  9  dB  is  desirable  from  the 
standpoint  of  total  crossings  and  first  crossings.  The  computer 
loading  for  9  dB  is  about  100  status  units  per  ping  cycle,  which 
appears  to  be  an  acceptable  number  from  a  computer  loading  stand¬ 
point.  For  6  dB  the  computer  loading  is  higher,  220  status  units, 
but  has  not  reached  unreasonable  levels;  whereas,  12  dB  requires 
very  little  computer  storage,  25  status  units,  other  than  program 
storage.  For  further  studies  a  design  signal-to-noise  ratio  of 
9  dB  will  be  adopted. 


H.  A.  Reeder  and  K.  D.  Record,  "Computer  Aided  Detection  (U)," 
TRACOR  Document  68-1238-C,  19  November  1968,  CONFIDENTIAL. 
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The  data  in  Table  4-IImay  also  be  used  to  compare  the- 
performance  of  the  SLR  and  non- SLR.  For  the  lowest  display  level 
(highest  false  alajrm  probability,  PFA  »  1.68  x  10“3)  the  time  (in 
number  of  pings)  to  first  crossing  of  the  threshold  is  about  the 
same  but  the  persistence  of  marking  after  the  first  crossing  is 
significantly  better  for  the  SLR.  On  the  other  hand,  the  total 
number  of  crossings,  while  greater  for  the  SLR,  is  not  significantly 
greater.  For  the  next  level  (PFA  -  1.8  x  10"^)  the  persistence 
is  again  significantly  greater  for  the  SLR  both  after  the  initial 
crossing  and  in  addition  for  the  entire  run.  For  the  two  highest 
(two  lower  false  alarm  probabilities,  PFA  »  1.4  x  10"  ^  and 
8.2  x  10"7)  the  persistence  after  the  first  crossing  is  short 
for  both  SLR  and  non- SLR  but  the  time  of  the  first  crossing  is 
much  sooner  for  the  SLR  than  the  non- SLR.  Again,  the  total 
number  of  threshold  exceedings  is  much  higher  for  the  SLR  than 
the  non- SLR. 


non- SLR  at  P 


FA 


The  data  in  Table  4- It  also  indicate  that  the  SLR 

10’^  performs  very  similarly  to 

similar  performance  also  exists 
-5 


being  thresholded  at  PFA  -  1.8  x 

1.68  x  10"^; 


with  the  SLR  set  at  PFA  ■  1.4  x  10  J  and  the  non- SLR  set  at 


PFA  -  1.8  x  10 


-4 


This  means  that  the  SLR  can  allow  the  operator 
to  reduce  the  false  alarm  probability  (and  hence,  rate)  signifi¬ 
cantly  (approximately  an  order  of  magnitude  in  this  case)  while 
maintaining  the  same  detection  performance.  The  operator  then, 
has  an  easier  Job  in  evaluating  the  reduced  amount  of  data,  since 
there  is  significantly  less  of  it  for  him  to  process. 


4.6  Noise  Spoke  Suppression 

The  principal  problem  has  been  processing  the  ARL 
digital  sonar  data.  On  some  runs  the  noise  background  contains 
persistent  noise  spokes.  The  original  ARL  normalizer  used,  that 
is,  dividing  an  output  sample  by  the  mean  of  the  samples  in  an 
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annulus  around  it,  did  not  remove  these  spokes  entirely.  The 
SLR  processor  tends  to  integrate  the  residual  noise  spokes  in 
the  same  manner  as  signal-plus-noise,  the  result  being  a  pre¬ 
ponderance  of  spurious  noise  tracks.  Therefore,  the  initial 
results  of  the  SLR  processing  were  disappointing  for  those  runs 
in  which  noise  spokes  were  pronounced. 

ARL  has  subsequently  implemented  a  noise  spoke 
suppressor  which  has  been  used  with  some  success.  The  first 
step  of  the  suppressor  is  to  average  the  sample  to  be  normalized 
with  the  maximum  adjacent  sample,  yielding  an  effectively  longer 
averaging  time.  Then  an  estimate  of  the  mean  of  the  noise  in  that 
beam  is  subtracted  from  the  overaveraged  sample.  This  estimate  is 
determined  by  finding  the  mean  of  those  samples  in  the  annulus 
that  are  also  within  one  beam  width  of  the  sample  to  be  normalized. 
(ARL  reports  that  an  amplification  factor  of  two  on  this  mean 
estimate  yields  better  results  for  runs  with  pronounced  noise 
spokes.  However,  for  consistency  between  runs  and  to  achieve  an 
unbiased  estimate  (in  the  statistical  sense)  of  the  excess  of  the 
sample  above  noise  level  of  the  beam,  an  amplification  factor  of 
unity  was  used  for  all  SLR  runs.) 


*  f 
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The  implementation  of  this  noise  spoke  suppressor 
improved  the  results  of  the  runs  where  spokes  were  a  problem. 

The  improvement  is  relative.  The  overaveraging  degraded  the 
signal-plus-noise  samples  to  some  extent;  but  the  overaveraging 
along  with  the  subtracting  the  estimate  of  the  noise  mean  in  that 
beam  reduced  the  noise  spokes  much  more.  Although  the  imnrovement 
was  considerable,  the  problem  of  noise  spokes  was  not  completely 
eliminated. 
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5.0  SLR  DISPLAY  STUDY 

5.1  Introduction  and  Purpose  of  Study 

This  section  describes  details  and  results  of 
an  observer  study  carried  out  by  TRACOR  personnel  to  validate 
experimentally  a  processor  that  utilizes  as  its  basic  tool  the 
Sequential  Likelihood  Ratio  (SLR)  test.  The  SLR  processor  is 
applied  to  the  sonar  signal  processing  sequence  at  the  input  to 
the  operator  display,  i.e.,  just  after  signal  processing  has  been 
completed  on  the  input  waveform.  The  processor  depends  upon  the 
statistics  associated  with  the  processed  waveform,  and  requires 
that  probability  distributions  be  derived  for  the  noise- only 
background  and  for  the  signal- plus-noise  background.  By  applying 
the  theory  of  maximum  likelihood,  the  processor  has  the  capability 
to  perform  simple  hypothesis  testing  on  each  time  sample  it 
receives;  that  is,  to  test  the  hypothesis  HQ:  no  target  present 
vs  target  present.  The  processor  can  improve  its  performance, 
taking  advantage  of  computer  speed  and  storage  capabilities,  by 
integrating  over  several,  or  many,  time  samples  and  performing 
sequential  likelihood  ratio  tests.  This  type  of  ping-to-ping 
integration  is  performed  internally,  with  the  decision  to  display 
the  integrated  data  dictated  by  the  build-up  of  the  likelihood 
ratios.  The  operator  is  presented  with  only  that  data  which  has 
been  accepted  under  hypothesis  Hp  resulting  in  a  less  cluttered 
display  than  if  the  same  integration  had  been  performed  visually. 
This  factor  becomes  important  when  the  operator  is  required  to 
view  a  display  containing  many  beams  or  channels  of  data. 

Before  implementing  such  a  processor,  one  would 
like  to  evaluate  its  performance  under  operational  conditions. 

This  study  attempts  to  do  this  by  presenting  to  trained  observers 
the  outputs  of  both  an  SLR  processor  and  a  non -SLR  processor  that 
have  operated  on  actual  recorded  sea  data.  The  data  were  furnished 


0800  TRACOR  LANE,  AUSTIN,  TEXAS  7*721 


by  the  Applied  Research  Laboratory  (ARL)  of  The  University  of 
Texas.  ARL  processed  a  number  of  stave  recordings  made  at  sea 
through  a  digital  beamformer  and  signal  processor,  making  available 
the  outputs  on  digital  tape.  These  tapes  then  provide  a  multibeam 
realistic  data  base  for  the  processor  evaluation. 

Results  from  the  observer  trials  can  be  used  to 
validate  the  performance  of  the  SLR  processor  as  compared  with 
theoretical  evaluations  already  obtained. 

5.2  Description  of  TRACOR  Display  Facility 

5.2.1  Hardware  -  The  TRACOR  display  facility  utilized 

for  the  observer  study  consisted  of  a  magnetic  tape  transport,  a 
system  control  unit,  a  core  memory,  and  eight  black  and  white 
television  monitors. 

The  general  operation  of  the  system  is  as  follows: 

1.  Magnetic  tapes  containing  the  information  to 

be  displayed  are  generated  off-line  using  the  UNIVAC  1108  computer 
facility.  For  any  particular  display  problem,  the  programmer  must 
create  a  driver  program  that  utilizes  standard  software  routines 
developed  especially  for  the  display  facility.  This  program  creates 
the  tapes  which  contain  digital  data  representing  the  output  of  a 
sonar  signal  processing  sequence. 

2.  The  digital  tape  transport  is  then  used  to 
transfer  information  from  the  magnetic  tape  to  the  core  memory. 

3.  The  system  control  unit  sequentially  scans  the 
core  memory  and  transfers  the  information  to  the  television  display 
monitors.  This  is  done  at  an  equivalent  60  Hz  rate  so  that  a 
flicker  free  display  is  obtained. 
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5.2.2  Software  -  The  software  package,  together  with  the 

driver  program,  provides  extremely  flexible  control  over  the  instru¬ 
mentation.  The  software  makes  available  122,760  independent 
addressable  locations  or  spots  on  the  CRT  display,  a  matrix  with 
dimensions  330  x  372.  Each  spot  may  assume  any  of  eight  grey 
levels,  from  black  to  white.  The  software  establishes  the  matrix 
as  the  first  quadrant  of  a  Cartesian  coordinate  system.  Spots 
may  be  displayed  by  specifying  the  coordinates  of  the  spot  and  its 
intensity.  Subroutines  have  been  developed  that  use  certain  of 
the  spots  to  display  lines,  arc  segments,  alphanumeric  characters, 
and  bounded  polygonal  regions. 

5.3  Display  Format 

The  displays  were  generated  in  a  B-scan  type  format 
retaining  a  five  ping  history.  The  vertical  axis,  considering 
the  face  of  the  display  as  the  first  quadrant  of  a  Cartesian 
coordinate  system,  contained  372  grid  points,  of  which  333  were 
used  (allowing  for  margins  at  the  top  and  bottom)  to  define  the 
range  sector.  The  displays  presented  the  minimum  range  at  the 
bottom  of  the  grid,  with  the  maximum  range  being  shown  at  the  top. 
No  raster  lines  or  tic  marks  were  used  on  the  vertical  axis  to 
label  or  define  the  actual  ranges  under  consideration.  The 
horizontal  axis,  containing  330  grid  points,  defined  the  beams, 
or  bearing  sectors.  Twenty-four  beams  were  displayed,  each 
defining  a  sector  7.5  degrees  in  width.  Raster  lines  were  drawn 
to  define  the  beams.  The  even  numbered  beams  were  labeled  at  the 
bottom  margin;  beam  24  was  excluded  due  to  space  limitations.  The 
ping  histories  were  carried  along  the  horizontal  axis;  thus,  a  given 
beam  could  contain  up  to  five  marks  for  any  given  range  bin.  The 
updating  procedure  worked  from  left  to  right,  with  the  current 
ping  information  displayed  at  the  left-most  portion  of  the  berm 
and  the  four  past  pings  stored  to  the  right.  As  a  current  ping 
was  being  displayed,  the  oldest  ping  (i.e.,  five  pings  old)  was 
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eliminated,  with  the  remaining  four  pings  of  data  each  shifted 
one  position  to  the  right.  Additionally,  the  current  ping  number 

being  displayed  was  recorded  in  the  upper  margin  at  the  left  hand 

side  of  the  display. 

Care  was  taken  in  the  setting  up  of  the  display 
driver  program  to  insure  th^t  the  target  track  always  appeared 
somewhere  on  the  grid,  but  that  it  did  not  appear  in  the  same 
place  (for  example,  centered)  for  each  run. 

5.4  Data  Processing  Sequence 

This  section  describes  the  data  processing  that 
was  necessary  to  convert  the  recorded  sea  data  into  a  form  suitable 
for  display. 


ARL  generated  a  series  of  tapes  that  contained  the 
outputs  of  a  digital  beamformer  and  signal  processor.  Actual  sea 
data  was  processed  through  this  simulated  AN/SQS-23  which  has  a 
multibeam  capability,  with  the  resulting  outputs  being  range, 
bearing,  and  amplitude  information  for  each  of  48  beams  on  each 
ping  cycle.  Ideally  one  would  like  this  data  to  contain  informa¬ 
tion  not  only  about  the  noise  background  but  also  about  the  signal 
or  target  background.  However,  since  controlled  recordings  of 
describable  target  behavior  are  difficult  to  obtain,  ARL  provided 
simulated  target  recordings  by  injecting  a  target  signal  into  the 
recorded  noise  data.  This  resulted  in  12  fifty-ping  runs  with  a 
target  signal  that  was  varied  from  approximately  0  dB  signal- to- 
background  ratio  (at  the  processor  input)  at  the  start  of  the  run 
to  18  dB  at  the  end  of  the  run  with  the  S/K  level  increasing  2  dB 
every  5  pings.  The  target  tracks  associated  with  these  12  runs 
were  of  the  straight  line  constant  speed  type.  One  additional  run 
was  generated  in  which  the  $/N  wa3  held  cons tart  over  the  entire 
ping  sequence  but  the  track  was  that  of  a  maneuvering  target. 
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TRACOR' s  CDC  3200  FORTRAN  version  of  the  SLR 
processor  was  used  in  the  initial  data  processing  of  the  ARL  data 
tapes.  This  program,  previously  described  in  Appendix  B,  performs 
the  necessary  tape  processing  and  bookkeeping  functions,  and  accepts 
the  data  in  a  format  standardized  by  ARL  The  program's  two  basic 
functions  are  the  formation  of  log  likelihood  ratios  and  the 
application  of  a  tracking  algorithm.  For  SLR  processing,  each 
data  sample  that  results  in  a  likelihood  ratio  greater  than  a 
certain  lower  threshold  is  subjected  to  the  tracking  algorithm 
and  possibly  linked  with  other  data  samples  in  a  manner  dictated 
by  the  possible  geometries  of  a  target  track.  These  linkages 
result  in  a  formation  of  sequential  likelihood  ratios  and  are 
carried  in  the  program  (processor)  until  they  ultimately  fall 
below  a  lower  threshold  and  are  dropped  out,  or  exceed  an  upper 
threshold  and  are  displayed  (or  in  our  case  written  as  output  on 
a  data  tape) .  The  important  thing  here  is  to  control  the  number 
of  linkages  the  processor  must  maintain  in  consideration  of 
computer  loading  and  time  requirements.  This  control  can  be 
exercised  by  proper  choice  of  the  design  signal- to-noise  ratio 
used  in  calculating  the  likelihood  ratios.  After  an  initial 
examination  of  the  data,  9  dB  was  determined  to  be  a  reasonable 
choice  for  this  parameter  and  was  used  to  process  each  run.  The 
data  output  to  tape  by  the  processor  consisted  of  the  significant 
range-bearing-likelihood  ratio  samples  at  each  ping  cycle.  Those 
data  samples  which  were  significant  on  a  single  ping  basis  were 
flagged  so  that  they  could  be  sorted  exclusively  when  the  non-SLR 
displays  were  generated. 

The  generation  of  the  displays  was  done  on  the 
UN1VAC  1108  facility,  A  driver  program  was  written  utilizing 
special  display  software  routines.  The  program  transformed  the 
data  into  a  B-scan  type  format.  Input  to  the  driver  program  con¬ 
sisted  of  a  processor  output  tape  and  control  cards  defining  key 
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parameters.  These  parameters  specified  the  run  to  process,  the 
type  of  processor  (SLR  or  non- SLR) ,  the  range  sector,  the  beam 
numbers /bearing  sectors,  the  thresholds  used  to  control  the 
brightness  levels,  and  the  background  orientation. 

All  displays  were  generated  with  a  10  kyd  range 
sector,  the  only  differences  from  run  to  run  being  the  starting  or 
minimum  range  to  be  displayed.  Due  to  the  size  of  the  displays, 
only  24  of  the  48  beams  of  data  could  be  shown  at  the  same  time. 

The  program  made  it  possible  to  select  the  24  beams  separately  for 
each  ping  cycle  and  this  feature  was  used  to  generate  noise  only 
displays  by  eliminating  the  beams  containing  the  target  echoes. 

The  program  required  seven  threshold  values  to 
determine  the  brightness  levels  and  clutter  densities  for  each  run. 
The  thresholds  were  determined  from  an  empirical  examination  of 
the  background  data,  resulting  in  distributions  for  the  probability 
of  exceeding  threshold  vs  threshold  (likelihood  ratio  units)  for 
each  processor. 

These  distributions  were  initially  generated  for 
both  the  SLR  and  non-SLR  processors  by  combining  the  data  from  all 
13  runs.  The  thresholds  obtained  from  this  ensemble  obviously  will 
remain  constant  or  fixed  on  a  run  to  run  basis.  Additionally,  it 
was  decided  to  determine  the  distributions  for  each  run  separately, 
resulting  in  different  i.e,  adaptive,  thresholding  for  each  run. 
Sample  plots  of  these  distributions  are  shown  in  Figs.  5-1  and  5-2. 

The  final  step  in  determining  the  proper  display 
thresholds  was  to  select  a  set  of  noise-only  marking  probabilities; 
that  is,  the  probabilities  that  likelihood  ratios  obtained  from  the 
noise-only  waveform  will  exceed  certain  levels.  These  probabilities 
are  given  in  Table  5-1  and  are  tne  same  as  those  used  in  a  previous 
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table  5-i 

PROBABILITIES  OF  NOISE  MARKING 
AT  EACH  INTENSITY  LEVEL 


Intensity 

Level 

Probability  of  Marking  With 
Intensity  Level  Ii  or  Higher 

h 

0.05 

h 

0.0102 

h 

0.00168 

h 

0.18  x  10"3 

h 

0.14  x  10"4 

h 

0.82  x  10’6 

h 

0.33  x  10“7 
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SLR  display  study  .  It  is  important  when  comparing  the  SLR  vs 
non-SLR  processors  tliat  the  clutter  rates  and  brightness  levels 
for  the  noise -only  waveforms  be  the  same.  This  can  reasonably  be 
accomplished  by  correctly  setting  the  thresholds  corresponding  to 
the  appropriate  marking  probabilities.  Figure  5-3  illustrates  the 
way  in  which  the  thresholds  were  obtained. 


The  plots  shown  represent  the  probability  that  the 
noise-alone  waveform  will  exceed  display  threshold  as  a  function 
of  threshold  at  the  output  of  the  SLR  processor  and  at  the  output 
of  the  non-SLR  processor.  By  fixing  the  thresholds  as  shown  in 
this  figure,  the  displays  will  respond  in  the  same  way  to  both 
output  waveforms,  i.e.,  both  displays  will  contain  the  same 
number  of  marks  and  the  brightness  distribution  of  the  marks  will 
be  the  same,  if  the  probability  scale  is  partitioned  in  the  same 
way  on  both  distributions.  For  example,  the  partition  at 
Probability  ■  0.1  gives  a  threshold  value  for  each  distribution, 
T^  for  the  SLR  processor  and  T^  for  the  non-SLR  processor.  No 
marks  will  be  made  if  the  waveform  sample  is  less  than  T^  in  the 
SLR  procesjor  and  less  than  T^  in  the  non-SLR  processor. 
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The  next  partition  is  shown  for  purposes  of 
illustration  at  Probability  -  0.01.  This  partition  generates 
two  more  thresholds  Tg  and  T,J.  Similarly,  T-j  and  T^  are  determined 
at  the  third  partition.  The  brightness  distribution  and  the  density 
of  marking  on  the  two  displays  will  be  the  same  if  the  waveform 
samples  from  the  SLR  processor  lying  between  thresholds  T^  and  T2, 
between  thresholds  Tg  and  Tg,  etc.  are  marked  at  brightness  level 
#1,  brightness  level  #2,  etc.  while  the  waveform  samples  from  the 
non-SLR  processor  are  marked  with  the  corresponding  brightness 

H.  A.  Reeder  and  H.  Record,  "Summary  Report  on  Computer-Aided 
Detection  (U) TRAC0R  Document  68-1238-C,  Contract  NObsr  93220, 

19  November  1968,  CONFIDENTIAL. 
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if  they  fall  between  and  T^,  between  and  Tg,  etc.  This 
description  is  for  illustration  of  the  method.  In  practice, 
seven  brightness  levels  plus  black  were  employed. 

With  the  brightness  structure  and  marking  density 
identical  in  the  nor.-SLR  and  the  SLR  displays,  observer  response 
to  noise  alone  can  be  expected  to  be  identical  in  an  average  sense 
as  long  as  the  observers  operate  under  the  same  criterion  in 
responding  to  the  two  displays.  Variability  from  run  to  run  will 
be  expected  because  of  the  random  nature  of  the  detection  process, 
but  response  will  not  be  biased  by  differences  in  the  noise  marking 
on  the  displays  of  the  non-SLR  and  the  SLR  processors. 

The  thresholds  used  in  the  study  are  presented  in 
Tables  5-II  and  5-III.  One  difficulty  in  setting  the  thresholds 
that  control  the  upper  brightness  levels  was  that  there  were  not 
enough  data  samples  to  provide  empirical  estimates  corresponding 
to  the  smaller  marking  probabilities.  In  setting  a  level  seven 
threshold  corresponding  to  the  brightest  intensity,  one  needs  at 
a  minimum  enough  data  samples  to  estimate  •  0.33  x  10’ 7 ,  or 
1/0.33  x  10’ 7  °  3  k  107  samples*.  In  fact,  it  was  often  necessary 
to  estimate  the  last  three  intensity  levels,  especially  for 
individual  runs,  due  to  a  lack  of  data  corresponding  to  those 
smaller  probabilities.  Unfortunately,  this  situation  may  penalize 
the  SLR  processor  in  that  one  of  its  characteristics  is  the  ability 
to  rapidly  integrate  log  likelihood  ratios  in  the  presence  of  the 
target  signal.  The  need  to  discriminate  strong  target  tracks  at 
the  appropriate  Intensities  is  necessary  when  comparing  the  two 
processors . 

This  means  that  somewhere  around  360  fifty-ping  runs  are 
required,  remembering  that  the  normalizer  uses  a  peak  picking 
method  that  on  the  average  admits  about  1/9  of  the  original  data 
to  the  processor. 
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TABLE  5 -II 

.  THRESHOLDS  USED  TO  SET 
INTENSITY  LEVELS  FOR  THE  SLR  PROCESSOR 


Intensity 

1 _ Thresholds  (Log  Likelihood  Ratio  Units')  _ _ 

1 

2 

3 

Run 

4 

5 

6 

7 

i 

1.12 

0.72 

-0.44 

-2.94 

-2.94 

-0.70 

-2.94 

2 

8.46 

7.61 

6.01 

-0.49 

-2.00 

5.86 

-1.80 

3 

18.26 

18.00 

16.40 

3.50 

-1.22 

17.29 

0.41 

4 

27.0 

26.5 

27.0 

14.2 

2.16 

27.0 

4.46 

5 

30.0 

30.0 

30.0 

23.7 

23.0 

30.0 

8.0 

6 

35.0 

35.0 

35.0 

30.0 

30.0 

35.0 

25.0 

7 

39.0 

39,0 

39.0 

35.0 

35.0 

39.0 

33.0 
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TABLE  5-II--Continued 


Intensity 


8 

9 

Run 

10 

11 

12 

13 

-2.09 

-2.94 

0.32 

2.30 

-2.94 

0.49 

0.64 

-0.69 

7.32 

10.36 

-0.54 

7.26 

5.41 

3.02 

18.51 

19.80 

3.20 

18.14 

12.4 

13.0 

27.2 

27.7 

12.0 

27.6 

17.4 

23.0 

30.0 

30.0 

26.0 

30.0 

25.0 

30.0 

35.0 

35.0 

30.0 

35.0 

33.0 

35.0 

39.0 

39.0 

35.0 

39.0 

Ensemble 

Averaee 
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TABLE  5- III 

THRESHOLDS  USED  TO  SET  INTENSITY 
LEVELS  FOR  THE  NON-SLR  PROCESSOR 


Thresholds  (Log  Likelihood  Ratio  Units) 


1 

2 

3 

Run 

4 

5 

6 

7 

-0.28 

-0.30 

-1.10 

-2.94 

-2.94 

-1.28 

-2.9 

4.41 

3.97 

3.57 

-0.64 

-1.84 

2.90 

-1.8 

10.41 

10.08 

9.44 

2.41 

-1.24 

9.51 

0.4 

17.2 

16.1 

19.1 

10.8 

1.18 

21.5 

4.4 

28.0 

20.0 

20.0 

28.0 

8.0 

25.0 

33,0 

25.0 

25.0 

33.0 

37.0 

30.0 

37.0 

TABLE  5 -II I— Continued 
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5.5  Design  of  the  Observer  Study 

Thirteen  separate  runs  were  obtained  from  ARL  and 
subsequently  became  the  data  base  for  the  observer  study.  Each 
run  was  processed  to  generate  four  separate  display  runs,- making 
fifty-two  display  runs  to  be  shown.  The  design  of  the  study  can 
be  considered  to  be  a  2  x  2  factorial  experiment  arranged  in 
randomized  blocks.  Describing  it  in  this  way,  the  treatments  or 
factors  consist  of  two  processors,  SLR  and  Non-SLR,  and  two 
thresholding  methods,  fixed  and  adaptive.  In  addition  it  was 
observed  that  the  thirteen  runs  could  be  divided  into  two  groups 
or  blocks,  determined  by  the  background  clutter  densities;  thus 
high  density  and  low  density  runs.  Actually  this  blocking  was 
done  to  minimize  possible  learning  effects  that  might  occur  from 
showing  two  or  more  displays  of  similar  backgrounds  in  a  particular 
sequence.  An  additional  effort  was  made  to  disguise  similar  back¬ 
grounds.  This  resulted  in  creating  half  of  the  displays  in  reverse, 
i.e,  as  if  the  display  itself  were  flipped  over,  giving  the 
impression  of  different  backgrounds  and  also  resulting  in  different 
(reversed)  target  tracks.  All  of  the  displays  with  adaptive 
thresholding  were  treated  in  this  manner.  Although  this  reversal 
effect  is  therefore  confounded  with  the  thresholding  treatment, 
it  can  reasonably  be  ignored  in  the  analysis  by  assuming  that  the 
observers  will  operate  in  a  "symmetrical"  manner.  The  actual 
display  sequence  shown  to  thd  observers  was  generated  in  the  follow¬ 
ing  manner. 


The  runs  numbered  1  through  13  were  arranged  in 
two  groups  corresponding  to  high  and  low  clutter  densities.  There 
were  seven  high  density  runs  and  six  low  density  runs.  Since  the 
numerical  assignment  of  run  numbers  appears  to  have  no  significance, 
no  randomization  was  performed  on  the  ordered  sequence  1-13.  Instead 
treatment  combinations  of  SLR-FIXED,  SLR-ADAPTIVE ,  NON- SLR- FIXED, 
NON-SLR-ADAPTIVE  were  assigned  the  values  1-4  v  respectively.  The 
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viewing  sequence  was  determined  by  alternately  selecting  a  high  or 
low  density  run  and  obtaining  a  random  number  from  one  through  four 
to  determine  the  treatment  combination.  This  process  was  repeated 
until  all  52  displays  had  been  assigned  a  sequence  number. 

After  part  of  the  viewing  sequence  had  already  been 
shown,  it  was  decided  to  select  three  of  the  original  13  runs, 
remove  the  target  tracks  from  them,  ard  create  new  displays  similar 
to  the  ones  previously  described.  This  was  done  in  an  attempt  to 
better  understand  or  measure  the  false  alarm  rates  associated  with 
the  two  processors  under  investigation.  These  12  additional  displays 
were  interspersed  with  the  original  52,  after  randomizing  them  as 
described  previously. 

5.5.1  Description  of  the  Data  Taking  Process  -  A  total  of 

nine  subjects  participated  as  observers  although  several  did  not 
complete  the  entire  sequence  of  runs.  The  subjects  were  trained 
as  to  the  display  format  and  the  responses  required  of  them  on 
several  50  ping  training  tapes.  These  tapes  contained  a  background 
of  random  noise  over  which  a  simulated  target  track  was  injected. 

This  target  track  was  characterized  by  a  constant  speed  straight 
line  geometry  and  a  linearly  increasing  signal  to  background  ratio 
throughout  the  50  ping  sequence.  The  subjects  were  told  beforehand 
that  there  could  be  from  one  to  four  targets  on  any  of  the  runs  and 
were  asked  to  respond  to  each  ping  cycle  in  the  following  manner: 
Record  for  each  suspected  target  the  nearest  beam  number,  approxi¬ 
mate  range,  and  confidence  level.  The  beams  were  defined  on  the 
displays  by  raster  lines  and  beam  numbers,  but  the  subjects  were 
required  to  estimate  the  range  and  place  it  roughly  into  one  of 
three  equai  range  increments,  Rl,  R2,  ox  R3.  These  were  not  defined 
on  the  display  and  so  might  vary  from  subject  to  subject  on  border¬ 
line  cases.  The  confidence  levels  were  defined  by:  0  -  no  target 
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present;  1  -  possible  target  present;  2  -  probable  target  present; 
and  3  -  positive  target  present.  Although  the  subjects  closely 
monitored  each  ping  cycle  it  was  only  necessary  for  them  to  record 
any  change  in  status  that  might  have  occurred  from  ping  to  ping, 
thus  reducing  significantly  the  amount  of  data  taken.  A  typical 
response  sheet  taken  from  one  subject  on  one  run  is  shown  in 
Fig.  5-4. 

5, 6  Presentation  and  Discussion  of  Results 


Results  from  the  study  have  been  summarized  from 
the  tabulated  responses  and  are  presented  in  this  section. 

Ensemble  averages  for  runs  1-12  were  generated  for  each  processor, 
providing  a  significantly  larger  sample  size  than  run  to  run 
comparison.  Runs  1-12  are  all  similar  in  that  the  target  trac‘«:  was 
simulated  as  a  constant  speed  straight  line  nonmaneuvering  course 
with  a  stepwise  increasing  signal-to-noise  ratio.  Results  are  also 
presented  for  run  13,  which  had  a  maneuvering  target  with  a  constant 
signal-to-noise  ratio.  The  ensemble  averages  were  derived  from  a 
tabulation  of  405  observer  responses,  while  run  13  had  30  responses. 
An  additional  breakdown  shows  the  ensemble  with  206  responses  with 
the  SLR  processor  and  199  with  the  non-SLR  processor,  while  run  13 
shows  a  breakdown  of  18  and  12,  respectively.  It  was  decided  to 
combine  the  results  of  the  thresholding  types  after  an  examination 
of  the  data  revealed  no  significant  differences  could  be  attributed 
to  this  factor  .  As  previously  discussed,  this  result  could  be 
attributed  to  the  inability  to  accurately  estimate  the  upper 
threshold  values. 

Figure  5-5  presents  the  probability  that  the  subjects 
correctly  classified  the  true  target  track  for  a  given  run  in  the 
ensemble  as  a  function  of  ping  no.  (i.e.  time)  for  the  SLR  processor. 
The  three  curves  presented  represent  the  confidence  rating 

*See  Table  5-X,  page  80. 
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associated  with  classifying  the  target  track.  A  curve  of  a  given 
confidence  rating  was  generated  by  counting  the  number  of  correct 
calls  of  that  rating  or  higher  and  dividing  by  the  total  number 
of  possible  correct  calls,  for  each  ping.  95%  confidence  limits 
were  generated  at  selected  probabilities.  Figure  5-6  presents  the 
same  curves  for  the  non-SLR  processor,  while  Figs.  5-7  and  5-8 
present  these  results  for  run  13  alone.  Table  5-IV  gives  the 
earliest  ping  at  which  at  least  half  the  observers  had  correctly 
identified  the  target;  i.e.,  0.5  probability  of  detection,  for  a 
given  confidence  rating.  This  result  is  for  runs  1-12  only. 

Figures  5-9  and  5-10  summarize  the  incorrect  or  false 
target  calls  for  the  two  processors  averaged  over  runs  1-12.  The 
top  three  curves  give  the  average  number  of  false  target  calls 
per  ping  by  an  operator  for  a  given  confidence  rating.  The  bottom 
three  curves  present  this  same  information  in  a  cumulative  format; 
that  is,  they  give  the  average  cumulative  number  of  false  alarms 
per  ping  by  an  operator  for  a  given  confidence  rating.  95% 
confidence  limits  were  generated  at  selected  ping  numbers  for  the 
cumulative  false  alarm  curves.  These  curves  were  obtained  from 
the  displays  that  also  contained  the  true  target  tracks.  It  is 
difficult  to  measure  or  estimate  the  false  alarm  rate  from  this 
data  for  several  reasons.  First,  since  the  true  target  track 
becomes  more  easily  detectable  as  the  run  progresses  due  to  the 
increasing  S/N  ratio,  the  operators  tend  to  atop  calling  any  other 
potential  target  tracks.  This  is  evidenced  by  the  declining 
average  number  of  false  target  calls  after  about  ping  24  or  so. 
Another  problem  with  estimating  the  false  alarm  rate  is  that  the 
displays  present  a  five  ping  history  of  data  to  the  observers, 
and  it  is  difficult  to  provide  a  mathematical  formulation  of  what 
would  constitute  a  target  call.  For  example,  how  many  spots  out 
of  five  must  be  marked  and  at  what  intensity  levels  before  an 
operator  will  make  a  call.  Realizing  these  shortcomings,  a  false 
alarm  rate  can  be  estimated  from  this  set  of  data  by  obtaining  the 
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TABLE  5 -IV 

ESTIMATED  PING  NUMBER  AT  WHICH  PROBABILITY 
OF  DETECTICN  IS  0.5  OR  GREATER 


Confidence 

Rating 

Processor 

SLR 

Non- SLR 

Probable 

20 

20 

Possible 

24 

24 

Positive 

25 

26 

FIG.  5-10  -  FALSE  TARGET  CALLS  FOR  NON-SLR  PROCESSOR  AT  THREE  O 
RATINGS,  RUNS  1-12. 
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average  number  of  false  targets  called  during  a  run  and  dividing 
by  the  total  number  of  opportunities  to  call  a  false  target.  On 
a  single  ping  basis,  the  number  is  simply  the  total  number  of 
spots  on  the  grid  that  could  be  marked,  333  x  24  «  7992,  minus 
those  spots  which  would  contain  the  true  target  track.  Estimating 
the  target  track  to  be  contained  in  five  consecutive  range  bins 
and  three  consecutive  bearing  sectors,  we  have  7992  -  15  *  7977 
opportunities  to  call  a  false  target  on  each  ping,  or  50  x  7977  *» 

•fa 

398,850  opportunities  on  any  given  run.  Reading  from  the  bottom 
curves  from  Fig.  5-9,  and  from  Fig.  5-10  which  presents  the  same 
information  for  the  non-SLR  processor,  false  alarm  rates  for  a 
given  confidence  rating  are  calculated  and  presented  in  Table  5-V. 

Figures  5-11  and  5-12  present  the  false  target 
responses  to  run  13  alone.  Table  5-VI  gives  the  estimated  false 
alarm  rates.  It  is  difficult  to  draw  conclusions  from  this  data 
simply  because  the  variability  of  subject  responses  is  large  enough 

to  be  a  significant  factor  for  sample  sizes  this  small. 

♦ 

Figures  5-13  and  5-14  present  false  target  calls 
obtained  from  three  runs,  runs  1,  4,  and  9,  with  the  true  target 
track  removed.  Here  we  have  333  x  24  «*  7992  opportunities  to  call 
a  target  on  each  ping,  or  7992  x  50  -  399,600  opportunities  on  a 
given  run.  Table  5-VII  gives  the  estimated  false  alarm  rates  for 
these  runs. 


Over  runs  1-12  the  observers  recorded  a  total  of 
159  false  target  calls,  or  159/405  *»  0.39  false  target  calls  per 
observer  on  the  average.  Looking  only  at  runs  1,  4,  and  9,  73 
false  target  calls  from  a  sample  size  of  104  were  recorded,  for  an  a 
an  average  of  73/104  *  0.70  per  observer.  The  noise-only  display 


This  is  the  number  that  will  be  used  to  calculate  false 
alarm  rates  for  the  five  ping  history. 
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TABLE  5-V 

2  ALARM  RATES  FOR  RUNS  1-12 


Processor 

SLR 

Non-SLR 

1.15  x  10~6 

0.807  x  10‘6 

0.511  x  10~6 

0.404  x  10~6 

0,208  x  lO”6 

0.150  x  10~6 
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TABLE  5 -VI 

ESTIMATED  FALSE  ALARM  RATES  FOR  RUN  13 

tfonficleric  e  ’"  Processor 

Rating  SLR  \  Non-SLtT 

Possible  2,37  x  10'6 

Probable  1.67  x  10’6 

Positive  0,557  x  10'6 


1.67  x  10~6 
1.25  x  IQ"6 
0.627  x  10~6 


FALSE  TARGET  CALLS  FOR  SLR  PROCESSOR  AT  THREE  CONFIDENCE 
RATINGS,  RUNS  I,  4,  AND  9 
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TABLE  5 -VI I 

ESTIMATED  FALSE  ALARM  RATES  FOR  RUNS  1,  4,  AND  9 
WITH  TARGET  TRACKS  REMOVED 


Confidence 

Rating 

Processor 

SLR 

Non-SLR 

Possible 

3.52  x  10“6 

2.50  x  10'6 

Probable 

2.14  x  10"6 

1.43  x  10~6 

Positive 

1.25  x  10”6 

0.893  x  10"6 

LAN  Ei  AUSTIN.  TEXAS  7B721 


from  runs  1,  4,  and  9,  generated  101  false  target  responses  from 
a  sample  size  of  84,  or  101/84  =  1.20  false  targets  per  observer. 
The  point  is  simply  that  as  the  target  S/N  increased,  causing 
the  target  track  to  be  marked  at  higher  intensities  than  the 
background  noise,  the  observers  realized  that  this  was  "the" 
target  and  tended  to  stop  calling  any  other  potential  targets. 


An  effort  was  made  to  measure  the  average  target 
S/N  level  required  for  detection.  This  result  was  obtained  for 
each  processor  in  the  following  manner:  for  a  given  confidence 
rating  and  for  each  display  run,  the  first  ping  at  which  the  true 
target  track  was  identified  was  recorded.  This  ping  number  was 
then  mapped  with  the  proper  S/N  level  defining  the  target  track  as 
is  shown  in  Table  5-VIII.  In  the  event  a  subject  had  not  correctly 
identified  the  target  by  the  end  of  the  run  (ping  50) ,  a  value  of 
20  dB  was  assigned.  The  S/N  levels  thus  obtained  were  averaged 
and  the  results  for  each  processor  are  given  in  Table  5-IX. 


Table  5-X  provides  a  comparison  of  several  factors 
that  can  be  obtained  from  the  results.  Each  comparison  is  based 
on  detection  performance  as  measured  by  the  earliest  ping  to 
correctly  identify  the  target  with  a  particular  confidence  rating. 
In  each  case,  the  results  are  broken  out  only  into  the  two  factors 

under  consideration,  providing  each  factor  with  approximately  half 

■>v 

the  total  sample  size  of  405. 


The  first  comparison  gives  the  overall  detection 
performance  for  the  two  processors.  This  is  about  the  same  result 
as  given  in  Table  5-IV  for  the  0.5  probability  of  detection  for 
each  processor.  It.  can  be  seen  that  there  is  really  little  difference 
in  the  two  processors,  given  this  particular  data  base. 


Runs  1-12  only. 
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TABLE  5-VIII 

AVERAGE  TARGET  S/N  LEVEL  AT  EACH  PING 


Pins  No. 

Average  Target 
S/N  Level  (dB) 

1-5 

0 

6-10 

2 

11-15 

4 

16-20 

6 

21-25 

8 

26-30 

10 

31-35 

12  - 

36-40 

14 

41-45 

16 

46-50 

18 
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TABLE  5 -IX 

AVERAGE  TARGET  S/N  LEVEL  REQUIRED  FOR  DETECTION 


Confidence 

Rating 

Processor 

SLR 

Non-SLR 

Probable 

7.34 

7.54 

Possible 

8.63 

8.94 

Pos itive 

9.65 

9.95 
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TABLE  5-X 

SELECTED  COMPARISONS  BASED  UPON  AVERAGE  EARLIEST 
PING  NUMBER  TO  DETECT 


Confidence 


Processor  Type 


Rating 

SLR 

Non-SLR 

Possible 

20.30 

20.76 

Probable 

23.61 

24.39 

Positive 

26.14 

26.80 

Threshold  Type 

Fixed 

Adaptive 

Possible 

20.50 

20.54 

Probable 

24.17 

23.80 

Positive 

26.58 

26.34 

Background  Type 

High 

Density 

Low 

Density 

Possible 

22.62 

13.47 

Probable 

25.76 

22.26 

Positive 

28,39 

24.58 

Learning  Type 

Initial 

Advanced 

Possible 

20.77 

20.28 

Probable 

24.49 

23,51 

Positive 


27.06 


25.89 
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The  next  comparison  gives  a  result  that  was  not 
entirely  anticipated.  Initially  it  was  thought  that  thresholding 
on  a  localized  or  adaptive  basis  would  give  better  run  to  run 
performance  than  using  a  set  of  fixed  thresholds  for  each  run. 

This  proved  not  to  be  the  case.  As  to  a  comparison  of  the 
thresholding  methods  regarding  false  alarm  rates,  it  was  felt 
that  due  to  the  widely  varying  performance  of  the  operators  in 
calling  false  targets,  no  valid  conclusions  could  be  reached  with 
these  sample  sizes.  Therefore,  the  results  from  fixed  and  adaptive 
thresholding  were  combined  as  previously  stated. 

The  third  comparison  gives  a  measure  of  performance 
regarding  background  densities.  As  mentioned  in  Section  5.5,  the 
runs  were  divided  into  high  and  low  density  background  runs  for 
the  purposes  of  randomizing  the  viewing  sequence.  Specifically, 

runs  1,  2,  3,  6,  10,  and  11  were  considered  to  have  high  density 

■>v 

backgrounds,  with  an  average  of  10623  data  points  per  run  ,  while 
runs  4,  5,  7,  8,  9,  and  12  averaged  only  2508  data  points  per  run. 
As  would  be  expected,  it  is  easier  to  detect  a  strong  target  track 
in  a  low  density  background  clutter,  than  in  a  high  density  back¬ 
ground,  all  other  things  being  equal. 


The  final  comparison  attempts  to  measure  the  observer 
learning  curve,  i.e.,  as  they  became  more  familiar  with  the  display 
formats,  background  data,  etc,,  the  manner  in  which  their  detection 
performance  varies.  This  table  was  generated  by  considering  runs 
shown  in  the  first  half  of  the  sequence  vs.  thof.e  shown  in  the  second 
half  of  the  sequence.  It  would  appear  that  as  the  sequence  progressed, 
a  slight  improvement  in  classifying  the  target  track  was  shown. 


* 


For  the  SLR  processor 
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Figures  5-15  and  5-16  present  the  results  of  an 
analysis  of  the  behavior  of  each  processor  with  respect  to  intensity 
levels  associated  with  the  target  tracks  in  runs  1-12.  These 
figures  were  generated  by  sorting  each  run  ping  by  ping  and 
recording  the  first  ping  for  each  run  that  a  given  threshold  was 
was  exceeded.  The  sorting  routine  made  use  of  a  dynamic  target 
window  extraction  algorithm,  which  was  developed  due  to  some 
uncertainty  in  defining  the  location  of  the  target  tracks. 

Figure  5-17  present  the  average  intensity  levels  per  ping  main¬ 
tained  by  the  target  tracks,  for  each  processor.  Figure  5-18 
gives  the  average  track  intensity  level  maintained  per  run  for 
each  processor. 


5.7  Data  Normalization 


A  comparative  investigation  of  normalization 
techniques  was  not  undertaken  for  this  study.  However,  it  appears 
from  viewing  the  displays  that  work  in  this  area  may  be  necessary 
if  a  valid  comparison  of  the  two  processors  is  to  be  made. 

On  practically  every  run  there  was  a  decided 
nonuniformity  of  marking  with  respect  to  bearing  sectors.  That  is, 
certain  sectors  contained  a  high  density  of  marks  while  adjacent 
sectors  contained  few,  if  any  marks.  This  problem  could  possibly 
be  remedied  by  normalizing  within  bearing  sectors.  Another  problem 
with  the  data  as  observed  was  the  appearance  of  a  second  target- 
like  marking  structure  on  several  runs.  These,  of  course,  were 
called  as  targets  by  most  of  the  subjects,  and  affected  the  false 
alarm  rates.  This  problem  would  tend  to  degrade  the  overall 
performance  of  the  SLR  processor  due  to  its  tendency  to  integrate 
strong  target  signals  rapidly. 


I  OR  SLR  PROCESSOR  (ENSEMBLE) 


TRAC QR 


5.8  Summary  and  Conclusions  of  Observer  Study 

A  display  study  was  performed  using  student 
observers  trained  to  detect  targets  from  a  background  of  noise. 
Specifically,  the  study  was  carried  out  to  validate  the  performance 
of  TRACOR's  Sequential  Likelihood  Ratio  (SLR)  processor  using  re¬ 
corded  multi-beam  sea  data.  The  Apolied  Research  Laboratory  (ARL) 
of  the  University  of  Texas  supplied  the  data  which  consisted  of 
stave  recordings  processed  through  a  digital  beamformer  and 
signal  processor,  the  outputs  of  which  were  made  available  on 
magnetic  tapes  in  the  form  of  12  fifty-* ping  sequences  or  runs. 

A  simulated  target  track  was  added  to  each  run  since  the  recorded 
data  did  not  contain  target  signals  of  a  nature  th* "  would  provide 
meaningful  processor  comparisons. 

TRACOR's  Ct)C  3200  FORTRAN  version  of  the  SLR 
processor  wss  used  to  process  each  run,  ping  by  ping,  obtaining  as 
output,  on  snsgnecic  tape  the  significant  range-bearing-log  likelihood 
ratio  triplets.  These  in  turn  were  used  to  generate  the  displays 
in  a  range-  vs  bearing  format  using  a  UNIVAC  1108  FORTRAN  driver 
program  and  previously  developed  software.  The  entire  viewing 
sequence,  randomized  with  respect  to  background  densities  and 
processor  types,  was  shown  to  the  observers  using  TRACOR's  black 
and  white  display  facility  consisting  of  8  separate  viewing  stations 
or  monitors.  The  tabulated  observer  responses  were  then  used  to 
obtain  ping  by  ping  summaries  of  correct  and  false  target  calls  to 
be  used  in  the  processor  comparisons. 


follows : 


The  significant  results  of  the  study  are  listed  as 


(1)  There  was  no  appreciable  difference  in 
detection  performance  between  the  SLR  and  non-SLR  processors. 
Detection  performance  was  measured  by  the  number  of  correct  calls 
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identifying  the  target  out  of  the  total  number  of  opportunities 
to  identify  the  target. 

(2)  The  false  alarm  rates  were  somewhat  lower  for 
the  non-SLR  processor^  especially  for  the  noise-only  runs.  The 
false  alarm  rates  were  determined  by  dividing  the  number  of  false 
alarms  by  the  total  number  of  opportunities  to  make  false  alarms. 

(3)  Average  target  track  intensity  levels  as 
viewed  on  the  displays  were  somewhat  higher  (brighter)  for  the  SLR 
processor. 

(4)  Relatively  small  variations  in  setting  the 
display  brightening  thresholds  had  no  effect  upon  the  detection 
performance  of  either  processor. 

(5)  Observer  responses  to  false  targets  were 
greatly  reduced  in  the  presence  of  a  strong  target  signal  for 
either  processor. 

The  study  was  somewhat  limited  xn  scope  in  that  the 
encounters  investigated  assure  fairly  rapid  and  certain  detect¬ 
ability  independent  of  the  processor  being  considered.  Additional 
investigations  should  define  a  lar ge  sampling  of  encounters  that 
would  demonstrate  marginal  detection  performance  for  each  processor 
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6.0  RECOMMENDATIONS 

The  SLR  processor  has  progressed  from  a  relatively 
crude  one-dimensional  processor  into  a  sophisticated  multidimen¬ 
sional,  multichannel  processor  capable  of  processing  large  amounts 
of  varied  data  types.  The  SLR  processing  of  sea  data  for  the 
observer  test  points  out  one  of  the  problem  areas  for  implementa¬ 
tion--  the  necessity  of  normalization.  A  basic  underlying  assumption 
in  the  SLR  processor  is  that  the  input  data  is  stationary  in  time 
and  space.  For  the  particular  data  base  used  in  the  present  study 
this  was  not  true  due  to  noise  spokes  at  certain  bearings  and 
variations  in  noise  backgrounds  from  run  to  run.  Based  on  this 
experience,  it  would  be  well  to  look  into  how  sensitive  Che  SLR 
processor  is  to  nonstationarity .  The  results  of  this  study,  along 
with  existing  information  on  how  well  various  normalization  schemes 
work,  would  allow  the  proper  selection  of  normalization  procedures. 

When  the  SLR  processor  is  considered  for  implementa¬ 
tion  on  a  moving  platform,  problems  will  arise  in  matching 
previously  stored  data  with  incoming  data.  There  are  two  possible 
ways  of  handling  this  problem.  The  first  establishes  the  ship 
as  the  basic  reference  point  ar.d  allows  targets  to  move  relative 
to  the  ship.  The  second  establishes  a  geographic  point  on  the 
earth's  surface  as  the  basic  reference  point,  and  the  ship  and 
targets  move  in  a  fixed  grid.  The  various  trade-offs  between  the 
two  systems  should  be  investigated  in  light  of  the  SLR  processor 
and  computer  requirements. 

vY 

Previous  studies’  indicate  that  an  improvement  in 
the  tracking  algorithm  may  yield  significant  gains  in  processor 


VY 

H.  A.  Reeder,  "Simultaneous  Likelihood  Ratio  Processing  for 
Two  Active  Receivers,"  Vol.  I,  TRACOR  Document  T71-AU-9594-U, 

25  August  1971. 
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performance.  One  possible  way  of  doing  this  is  to  utilize  observed 
tracking  errors  (difference  between  predicted  and  observed  target 
locations)  in  the  log  likelihood  ratio.  Using  this  concept)  widely 
varying  tracks  would  be  penalized  much  more  than  consistent  tracks. 
The  tracking  algorithm  and  its  effect  on  detection  performance 
and  computer  loading  is  potentially  the  most  fruitful  area  for 
improving  the  individual  SLR  processors. 

The  results  of  the  recent  observer  study  were 
disappointing  in  that  they  did  not  show  significant  differences 
between  SLR  and  non- SLR  processing.  However,  the  type  of  data 
and  the  amount  of  data  were  not  sufficient  to  make  a  definitive 
study.  If  a  different,  more  extensive  data  base  is  available, 
it  would  be  worthwhile  to  undertake  a  carefully  controlled 
observer  experiment. 

The  SLR  processors  for  the  Multireceiver  Automatic 
Alerting  System  are  nearly  complete,  lacking  only  the  narrowband 
processor.  It  is  recommended  that  this  SLR  processor  be  imple¬ 
mented  on  a  representative  narrowband  sonar  signal  processor  and 
evaluated.  Also  a  joint  wideband,  narrowband  SLR  processor  should 
be  developed  and  tested.  The  ultimate  aim  of  this  combined  system 
should  be  hardware  implementation  on  an  at-sea  platform  for 
definitive  operational  testing. 
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MATHEMATICAL  FORMULATION  OF  THE  SLR  PROCESSOR  AND 
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A. 1  STATISTICAL  HYPOTHESIS  TESTING  AND  THE  LIKELIHOOD 

RATIO 

A. 1.1  Simple  Alternative  Binary  Tests 

This  appendix  serves  two  purposes.  First,  it  gives 
the  reader  a  brief  introduction  to  statistical  decision  theory 
emphasizing  the  central  role  played  by  the  likelihood  ratio. 
Second,  it  describes  the  operation  of  the  sequential  likelihood 
ratio  processor  as  it  is  currently  implemented  by  TRACOR. 


The  fundamental  problem  of  statistical  decision 

theory  is  that  of  choosing  one  of  several  possible  hypotheses  by 

utilizing  information  gained  from  the  measurement  of  some  quantity. 

A  great  deal  of  generality  can  be  included  in  defining  the  algorithm 

to  optimally  carry  out  this  procedure,  but  a  simplified  approach 

will  be  taken  here.  For  a  background  in  statistical  detection 

1  2 

theory,  the  reader  is  referred  to  Helstrom  and  Hancock  and  Wintz  , 

and  for  further  study  in  sequential  analysis,  the  reader  is 

3 

referred  to  Wald. 


Carl  Helstrom,  Statistical  Theory  of  Signal  Detection. 
Pergamrn  Press,  New  York,  1960. 

2 

John  C.  Hancock  and  Paul  A.  Wintz,  Signal  Detection  Theory. 
McGraw  Hill  Book  Company,  New  York. 

3 

A.  Wald,  Sequential  Analysis.  John  Wiley  &  Sons,  Inc.,  New 
York,  1948. 
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The  problem  now  is  to  decide  whether  to  accept  Hq 
or  given  the  observation  x  where  Hq  is  the  noise  hypothesis 
and  is  the  signal  hypothesis.  In  the  conceptually  simple 
problem  posed  here  we  have  a  case  of  simple  hypothesis  testing 
which  has  been  treated  extensively  in  the  literature.  An  excellent 
treatment  of  this  problem  is  given  in  Ref.  [2].  In  this  reference 
it  is  shown  that  a  functional  known  as  the  likelihood  ratio  plays 
a  central  role  in  the  theory  of  statistical  hypothesis  testing. 

The  likelihood  ratio  L(x)  is  defined  by, 

L(x)  ^ 


PlOO 
Pq  (x) 


where  p^(x)  and  Pq(x)  are  the  probability  density  functions 
associated  with  the  hypothesis  H-^  and  Hq,  respectively.  The  sense 
in  which  this  quantity  plays  a  central  role  is  the  following.  When 
one  attempts  to  make  decisions  of  the  type  dealt  with  above,  it  is 
reasonable  to  attempt  to  make  that  decision  in  a  fashion  that  is 
optimum  according  to  some  criterion.  Through  the  years,  there  have 
been  numerous  criteria  of  optimality  developed.  The  variation  in 
criteria  of  optimality  has  resulted  from  essentially  two  causes. 
First,  the  situations  or  contexts  in  which  the  decision  is  to  be 
made  are  diverse,  e.g. .  testing  lots  of  seeds  for  the  presence  of 
certain  strains  or  testing  electrical  signals  for  the  presence  of  an 
echo  from  an  attacking  aircraft  or  guided  missile.  Clearly,  the 
motivations  and  constraints  behind  these  two  decision  processes 
are  different.  Second,  the  level  of  knowledge  concerning  the 
factors  other  than  Pq(>0  and  p^(x)  is  highly  variable.  For  example, 
there  are  cases  where  the  costs  of  incorrect  decisions  can  be 
assessed  fairly  accurately  as  can  be  the  a  priori  probabilities 
of  the  events  associated  with  Hq  and  H^.  Before  enumerating  some 
of  the  more  commonly  encountered  criteria  used  in  statistics  it 
will  be  convenient  to  introduce  some  notation.  When  binary  (yes-no) 
decisions  are  made,  two  types  of  errors  can  be  made.  The  probability 
of  these  errors  plays  an  important  role  in  describing  the  utility  of 
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the  particular  approach  that  is  taken  to  decision  making.  Using 
conventional  notation  these  errors  are, 

a  «*  probability  of  rejecting  Hq  when  in 
fact  Hq  is  true. 

This  is  called  a  type  1  error  by  statisticians  but  in  a  target 
detection  theory  context  it  amounts  to  the  probability  of  rejecting 
the  "target- absent"  hypothesis  when  in  fact  the  target  is  absent. 
Thus,  this  is  the  false  alarm  probability. 

0  «  probability  of  rejecting  when 
is  true. 

This  is  called  a  type  2  error  and  in  the  target  detection  sense  is 
the  probability  of  rejecting  the  "target-present"  hypothesis  (H^) 
when  in  fact  the  target  is  present.  Thus,  1-0  is  the  probability 
of  detection. 


Two  other  quantities  of  some  importance  are  the 
a  priori  probabilities  of  Hq  and  namely  tTq  and  rr^,  respectively. 
Often  in  practice  these  quantities  are  not  known  to  the  observer 
and  some  of  the  criteria  to  be  discussed  shortly  will  reflect  this 
fact.  Finally,  there  are  costs  that  may  sometimes  be  associated 
with  the  four  possible  outcomes  of  the  decision  process.  These 
are; 


Cqq  ■  cost  associated  with  choosing  Hq  when 
Hq  is  true 

Cqi  »  cost  associated  with  choosing  Hq  when 
is  true 

Cn  -  cost  associated  with  choosing  when 
is  true 
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Cio  =  cost  associated  with  choosing 
when  Hq  is  true. 

Having  defined  the  basic  quantities  associated 
with  simple  binary  hypothesis  testing,  some  of  the  more  common 
decision  theory  criteria  of  optimality  will  be  briefly  discussed. 

Let  it  be  borne  in  mind,  however,  as  these  criteria  are  discussed, 
that  the  function  of  a  criterion  is  to  tell  us  what  must  be  done 
with  the  observation  in  order  that  the  criterion  be  satisfied. 

This  is  simply  finding  the  operation  that  must  be  performed  on  the 
data.  Table  A-I  gives  the  criteria  and  the  properties  associated 
with  each.  As  can  be  seen  in  this  table,  regardless  of  the  choice 
of  criterion,  the  common  operation  that  must  be  performed  on  t!  a 
data  is  the  formation  of  the  likelihood  ratio.  Only  the  threshold 
testing  procedure  is  dependent  on  the  state  of  a  priori  knowledge 
and  the  motivation  of  the  observer.  Thus,  it  is  clear  that  the 
likelihood  ratio  is  a  most  fundamental  operation  in  statistical 
hypothesis  testing.  In  the  text  that  follows,  our  implementation 
of  the  likelihood  ratio  and  the  subsequent  application  to  processing 
sonar  data  will  be  discussed. 
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In  the  present  analysis  it  is  assumed  that  the 
quantity  to  be  observed  is  a  single  numerical  quantity  (voltage) 
available  at  the  output  of  the  sonar  processor  (e.g, ,  a  correlator) . 
This  quantity  is  indexed  by  ping  number s  range,  bearing,  and 
possibly  Doppler.  In  other  words  we  have  available  amplitude 
information  from  every  range-bearing-Doppler  resolution  cell,  on 
every  ping  cycle.  If  the  hypothesis  Hq  is  true  for  the  particular 
elemental  volume  of  the  ocean  in  question,  then  observed  values  of 
the  quantity  x  will  be  described  by  a  known  probability  density 
function,  Pq(x),  such  as  the  example  shown  in  Fig.  A-l.  Similarly, 
if  the  hypothesis  is  true,  there  will  be  a  different  probability 
density  function,  p^(x),  which  describes  the  quantity  x,  as  shown 
in  Fig.  A-l.  For  this  example,  Pq(x)  is  Che  probability  density 
function  describing  the  processor  output  with  noise  alone  input  to 
the  processor,  and  p^(x)  is  the  probability  density  function 
describing  the  processor  output  with  signal-plus-noise  input  to  the 
processor.  Thus,  the  likelihood  ratio  is  defined  as  before  by, 


L(x) 


A 


piw 

i>oM  ' 


In  many  cases  and  as  shown  in  Fig.  A-l,  the  likeli¬ 
hood  ratio  is  a  tnonotonically  increasing  function  of  the  observa¬ 
tion  quantity  x.  Here,  large  values  of  L(x)  tend  to  imply  that 
Hq  is  true.  Thus,  in  principle,  a  decision  threshold  can  be 
established  for  testing  L(x)  according  to  one  of  the  criteria 
presented  in  Table  A- I 

A. 1.2.  Multiple  Observations 

If  n  observations  of  the  quantity  x  are  to  be  made 
at  separate  points  in  time,  or  specifically  on  successive  echo 
cycles,  thereby  resulting  in  the  sequence  (st^,  X2,  x-j,  ....  x^) 
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then  a  joint  likelihood  ratio,  L(xp  x2,  x^,  . xn)  can  be 
defined  based  upon  the  n  dimensional  probability  density  functions, 
Pl<xl,  x2,  x3,  xn)  and  p^x^  x2,  x3,  . xn)  ,  similar  to 

pQ(x)  and  p-^(x).  The  joint  likelihood  ratio  is  then 


L(x^ ,  x2» 


pl^xl*  x2’  x3»  xn^ 

P0(x  ,  x2,  x3»  ...»  xn) ‘ 


If  the  observations  (X| ,  x2,  x^,  . xn)  can  be  considered 
statistically  independent,  then  the  appropriate  multidimensional 
probability  density  function  can  be  described  as  the  product  of 
the  individual  probability  density  functions,  thus 


L(x 


1»  *2’ 


x. 


px  (xp  .  Pl(x2)  •  PL(x3)  ...  •  Px,(*n) . 
•  p0(x2)  .  p0(x3)  PD(xn) 


This  yields  a  significant  simplification  in  the  determination  of 
processor  output  statistics,  and  leads  to  the  suggestion  of  the 
log  likelihood  ratio,  -t(x^),  which  is  formed  by  taking  the  loga¬ 
rithm  of  L(x^),  thus 


t(x1)  ^  Log  *  Log 


t(xt)  “  Log  [Pi j  -  Lo8  [po(*P].  and 
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The  procedure  of  adding  rather  than  multiplying  lends  itself 
quite  well  to  a  digital  computer,  however,  the  process  of  taking 
a  logarithm  ran  be  time  consuming.  Consequently,  a  linear  approxima¬ 
tion  to  the  log  likelihood  ratio  deserves  consideration.  This  will 
be  discussed  in  a  later  section  of  this  appendix. 

A. 1,3  Sequential  Hypothesis  Testing 

It  is  of  interest  to  consider  next  a  system  in  which 
the  number  of  observations  is  not  a  fixed  quantity  but,  instead,  a 
decision  is  to  be  made  when  specified  confidence  levels  are  reached. 
This  technique  which  was  introduced  earlier,  is  known  as  sequential 
testing,  and  requires  that  two  thresholds,  T^  and  TD  be  established. 
In  the  case  at  hand,  the  threshold  T^,  with  (x)  *  (x^,  ..., 

Xj),  is  chosen  such  that  if  the  value  of  the  log  likelihoud 
ratio,  t(x),  falls  below  T^,  the  decision  is  made  that  is  true, 
that  no  target  is  present.  Thus,  the  track  is  rejected  as  noise, 
and  the  testing  chain  scops. 

Similarly,  T^  is  chosen  such  that  if  {.(x)  exceeds 
TD,  the  decision  is  made  that  is  true,  that  a  target  is  present. 
This  completes  the  detection  process  in  a  sense,  but  in  our 
application  the  testing  procedure  does  not  stop.  Rather,  the 
sequential  testing  continues  and  forms  an  automatic  track.  If  the 
value  of  -t(x)  lies  between  the  thresholds,  that  is,  if 

\  <  <•(!!)  <  tD 

then  Che  decision  is  made  to  retain  the  track,  but  not  display  it. 
Following  this,  another  sample  is  taken,  t(x)  is  updated,  and  the 
new  t(x)  is  compared  with  T^  and  T^. 
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This  process  is  very  similar  to  the  random  walk 
problem,  and  it  can  be  shown  that  eventually,  with  probability  1, 
one  of  the  two  thresholds  will  be  crossed  and  a  decision  will  be 
reached.  The  average  number  of  samples  required  to  reach  a 
decision  for  given  probabilities  of  wrong  decisions  for  the 
sequential  test  described  above,  is  less  than  the  number  required 
for  a  fixed  sample-size  test  with  the  same  probabilities  of  error, 
a  and  8  .  If  the  track  is  noise,  the  decision  is  reached  relatively 
promptly,  but  if  the  track  is  a  target,  a  significantly  greater 
number  of  samples  may  be  required  for  a  decision . 

A. 1.4  Tracking  With  the  SLR  Procedure 


In  sonar  applications  one  difficulty  arises  which 
does  not  often  occur  in  other  statistical  decision  theory  applica¬ 
tions.  Tliis  problem  is  that  one  does  not  really  know  uniquely 
how  to  make  a  single  'next”  observation.  For  example,  receipt  of 
a  modestly  large  sample  on  one  beam,  at  a  given  range  and  perhaps 
wi th  some  Doppler,  gives  an  indication  of  approximately  where  to 
look  in  the  next  echo  cycle,  in  terms  of  beam,  range,  and  Doppler. 
This  information,  however,  caunct  give  a  precise  specification  of 
the  location  of  the  linking  sample  in  the  next  echo  cycle.  Thus, 
the  process  is  more  complex  than  the  classical  sequential  test 
which  is  conducted  in  a  single  resolution  cell.  The  information, 
i.e. .  range,  bearing,  Doppler,  and  amplitude,  gained  from  thu 
received  sample  on  the  present  ping  cycle  defines  a  range-bearing- 
Doppler  volume  in  the  next  echo  cycle  which  must  be  searched  if 
data  on  successive  ping  cycles  are  to  be  associated  or  linked. 

Tills  process  can  be  better  understood  if  one  examines  th?  situa¬ 
tion  depicted  in  Fig.  A- 2. 

In  this  figure,  the  upper  diagram  (Fig.  A-2(a)) 
shows  a  highly  idealised  version  of  a  target  track  that  has 
developed  over  .a  three  pitvg  sequence.  On  the  (i-l)ca  ping  the 
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Search  Area  to  be  Used  on  Ping  i 
•Target  Mark  on  (i-l)th  Ping  Cycle 

Target  Mark  on  Ping  Cycle 

Search  Area  to  be  Used  on  Ping  (i+1) 
■Target  Mark  on  (i+l)th  Ping  Cycle 

Predicted  Position  of  Target  on 
'(i+l)th  Ping  Cycle 


(a)  B-Scan  Display  of  Sonar  Data 
Showing  3- Ping  History 


Projection  of  Range  of 
Possible  Target  Posi¬ 
tions  on  Next  (i*^) 
Ping  Cycle 


Ping  ; 

Cycle  i-1  | 
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Projection  of  Range  of 
Possible  Target  Posi-N 
cions  on  (i+l)th  Ping 
Cycle  Based  on  Track 
History 
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B-Scan  Formatted 
Sonar  Data  on  Suc¬ 
cessive  Ping 
Cycles 

(b)  B-Scan  Format¬ 
ted  Sonar  Data 
Showing  3-Separate 
Echo  Cycles  and 
Evolution  of  SLR 
Tracking  Windows 
(Search  Areas) 
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DIAGRAMATIC  REPRESENTATION  OF  SLR  ALGORITHM  TRACKING  DYNAMICS 
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target  occupies  a  certain  range-bearing  resolution  cell.  Since 

this  is  the  only  information  (i.e .  ,  range,  bearing,  and  amplitude) 

that  we  have  concerning  the  target,  it  must  be  concluded  that  on 

the  next  ping,  ping  i,  the  target  is  likely  to  appear  anywhere  in 

a  rather  large  area  of  range  and  bearing  whose  size  is  dictated 

by  the  maximum  target  motion  that  could  occur  between  pings. 

This  search  area  is  shown  in  the  upper  right-hand  part  of 

Fig.  A-2 (b)  as  the  large,  heavily  marked  area  around  the  target 

mark.  As  is  shown  in  this  figure,  this  search  area  is  projected 

onto  the  B-scan  format  of  the  ic  echo  cycle  so  that  the  search 

t“h 

for  a  target  mark  to  associate  with  the  (i-1)  ping  cycle  target 
mark  can  be  confined  to  a  reasonable  area.  On  the  i&  ping  cycle, 
we  have  shown  the  target  mark  appearing  in  the  lower  left-hand 
corner  of  the  i  ping  cycle  search  area.  Referring  back  to 
Fig.  A-2(a),  it  can  be  seen  that  with  the  two  pings  of  target 
motion  history  it  is  possible  to  predict  a  future  target  position. 
This  is  shown  in  Fig.  A-2(b)  as  a  projection  of  the  irregular 
area  from  ping  cycle  i  to  ping  cycle  i+1.  It  can  be  seen  that 
the  area  covered  by  the  search  area  for  ping  i+1  is  smaller  than 
the  search  area  that  was  used  for  the  i^  ping  cycle.  This  is  a 
reasonable  result  in  view  of  the  fact  that  more  information  is 
available  at  the  end  of  the  ic  ping  cycle  than  was  available  at 
the  end  of  the  (i-1)  th  ping  cycle.  (It  is  worth  pointing  out 
here  that  the  combination  of  the  information  such  as  range,  bearing, 
log  likelihood  ratio,  predicted  target  position,  and  size  of 
search  area  constitute  what  we  call  status  unit.) 


Now  when  the  target  echo  appears  In  the  projected 
search  areas  from  one  ping  cycle  to  the  next,  the  SLR  tracking 
algorithm  takes  advantage  of  this  by  forming  the  joint  log  likeli¬ 
hood  ratio  that  was  discussed  in  the  previous  section.  This  gives 
an  enhancement  of  the  target  echo  and  tends  to  increase  the 
signal- to-noise  ratio.  Unfortunately,  as  the  reader  has  probably 
already  guessed,  it  is  possible  for  two  other  types  of  events  to 
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occur  in  this  tracking  procedure  in  addition  to  the  pure  enhancement 
of  target  tracks.  First,  there  can  result  spurious  noise  tracks. 
These  are  tracks  that  develop  after  a  target  track  has  been 
initiated  and  when  a  noise -alone  sample  falls  in  the  search  area 
and  is  large  enough  to  cause  a  branching  track  from  the  target 
track.  This  results  from  the  fact  that  the  algorithm,  in  its  most 
general  form,  permits  multiple  linkages  to  be  formed  between  old 
tracks  and  new  data  samples  that  fall  in  the  search  area.  Second, 
it  is  entirely  possible  that  noise  alone  can  cause  tracks  to  be 
initiated.  This  occurs  whenever  the  noise  sample  exceeds  the  lower 
threshold  and  thereafter  is  treated  in  the  same  way  as  the  target 
echo  of  Fig.  A- 2  was  treated.  Here  again  multiple  linkages  can 
result  so  that  it  is  possible  for  a  multiplicity  of  noise  tracks 
to  exist.  The  technique  by  which  this  noise  behavior  is  controlled 
is  discussed  next. 


Since  multiple  linkages  are  allowed  in  this  process, 
the  definition  of  the  joint  likelihood  ratio  must  be  altered 
slightly.  The  joint  likelihood  ratio  for  the  case  in  which 
multiple  linkages  are  allowed  can  now  be  defined  as 


L'(x) 


Pi (a  1  H1>P1 

Pote  I  Vpo 


where  p^Qt  j  H^)  is  the  conditional  probability  density  function 
of  x  given  that  hypothesis  is  true.  P^  is  the  probability  that 
a  linkage  formed  is  with  the  target,  given  that  is  true  ;  and 
Pq  is  the  probability  that  the  linkage  formed  is  due  to  noise, 
given  that  Hq  is  true. 


1 

If  multiple  linkages  are  allowed,  there  is  a  probability 
that  a  true  target  track  can  link  with  a  noise  sample,  as  well  as 
a  target  sample,  consequently  the  joint  likelihood  ratio  must  be 
modified  by  P^. 


3 


E 
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For  the  purpose  of  this  analysis,  it  is  assumed  that 
Pq  is  exactly  unity.  It  is  also  assumed  that  is  the  number  of 
true  target  tracks  within  the  search  area  or  volume  divided  by  the 
number  of  possible  linkages,  including  target  and  noise  linkages. 

It  is  unlikely  that  there  will  be  more  than  one  target  track  in 
any  given  search  area  when  is  chosen,  so  the  average  number  of 
target  tracks  there  is  1.0.  Since  it  would  be  difficult  and  time 
consuming  to  count  the  number  of  possible  linkages  each  time,  the 
average  number  of  possible  linkages  will  be  used,  hence 


Pq  =  1.0,  and 


Thus  the  likelihood  ratio  L(x)  must  divided  by  the 
average  number  of  possible  linkages  under  hypothesis  H^.  That  is, 

L'(x)  «  and 

WAV 


4'(x)  ■  t(x)  -  Log  (Nav)  . 

This  reduction  of  the  likelihood  ratio  due  to  the 
allowance  of  multiple  linkages  implies  that  it  is  advantageous  to 
form  a  highly  localized  target  track.  This  is  precisely  what  is 
done  by  the  process  described  in  conjunction  with  Fig.  A-2.  As  a 
result  the  quantity  (N)  may  be  decreased  as  the  track  history 
builds  up  and  the  average  number  of  samples  required  to  make  a 
decision  when  a  target  is  indeed  present  may  be  decreased. 
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>roximations  Used  in  the  SLR  Processor 


As  is  so  often  the  case,  when  it  comes  time  to 
implement,  approximations  have  to  be  employed.  Some  of  the  more 
important  approximations  that  are  used  in  the  implementation  of 
the  SLR  processor  are  presented  in  this  section. 

Consider  first  the  likelihood  ratio  that  was 
discussed  earlier.  This  functional  is  defined  by  the  probability 
density  functions  that  hold  at  the  sonar  processor  output  for 
noise  alone  and  signal-plus-noise.  In  the  implementation  that 
we  have  carried  forth,  it  has  been  assumed  that  the  sonar  processor 
in  question  is  a  linear  replica  correlator  followed  by  an  envelope 
detector.  In  the  presence  of  a  Gaussian  noise-plus- steady  signal 
input  the  output  probability  density  function  is  given  by 


Pl(x)  -  f-  exp[-  ; s~]  I0(xs/to) 


where 


=*  noise  power  at  the  correlator  output 
s  “  signal  amplitude  at  the  correlator  output 
IQ  »  modified  Bessel  function  of  zero  order. 

When  noise  alone  is  present,  we  have  s  a  0  and  the  resulting 
probability  density  function  becomes 


P0<*>  = 
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The  likelihood  ratio  being  the  ratio  of  p^(x)  to  Pq(x)  becomes 


L(x)  *  e 


s2/21 


ioCsx/^) ; 


if  we  assume  that  normalization  has  occurred  (by  AGC  action  or 
the  equivalent)  we  can  treat  the  envelope  in  terms  of  the  quantity 
x/fn^  *  y.  (This  is  precisely  what  ideal  normalization  does,  i.e. , 
it  transforms  x  to  x/i|f  ^.)  Thus,  the  likelihood  ratio  can  be 
written, 


-s2/2* 


L(y)  -  e  n  x0(y 


If  we  define  the  peak  signal- to-noise  power  ratio  p  at  the  correla¬ 
tor  output  as, 

02  *  £ 

0  ill  > 

*n 

the  likelihood  ratio  becomes 


-  £ 

L(y)  »  e  IQ(py) . 


Using  the  asymptotic  expansion  of  Iq(z)  for  large  values  of 
z  --precisely  the  range  of  py  where  we  will  find  that  a  linear 
approximation  holds,  we  have  for  L(y)  approximately 


L(y)  «  e 


-„2/2  e»y  ; 

<2"py)' 


M.  Abramowitz  and  I.  A.  Stegun,  Handbook  of  Mathematical 
Functions,  Dover,  1965,  p  377,  Section  ^.7.  . ’ .  . 
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Taking  the  natural  logarithm  of  L(y)  gives 


In  L(y)  «  t(y)  «  py  -  (p2/2  +  \  In  2npy ) 

«  py  -  (p2/2  +  %  In  2tt  +  \  In  py). 

The  property  of  the  logarithm  is  such  that  for  large  values  of  py 
the  log  of  py  is  much  smaller  than  py,  this  last  equation  can  be 
written  as 

l( y)  «  py  -  <P2/ 2  +  ^  In  2rr) 

which  is  a  linear  approximation  to  the  logarithm  of  the  likelihood 
ratio.  This  function  and  the  logarithm  of  the  true  likelihood 
ratio, 


l( y)  -  In  I0(py)  -  p2/2 

are  plotted  in  Fig.  A-3.  In  this  figure  it  can  be  seen  that  over 
the  range  of  y  shown  there  is  quite  good  agreement  in  the  two 
functions.  In  practice  we  obtain  even  better  agreement  by  adding 
an  intercept  correction  factor  to  the  linear  approximation. 

Because  of  the  excellent  agreement  in  the  slopes  of  the  two  curves 
this  intercept  correction  suffices  to  bring  the  linear  approxima¬ 
tion  into  even  better  agreement. 

The  significant  point  here  is  that  the  parameter 
p  ,  which  is  the  assumed  and  hence  the  design  signal- to-noise  ratio, 
determines  the  slope  and  intercept  of  the  linear  approximation  to 
the  log  likelihood  ratio.  That  this  dependence  of  the  linear 
approximation  on  the  design  signal- to-noise  ratio  is  an  important 
relationship  will  be  made  clear  in  the  following  paragraphs. 
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Two  other  approximations  that  are  used  in  the  SLR 
processor  implementation  are  the  equations  for  the  upper  and  lower 
thresholds,  Tg  and  Tg  ,  respectively.  Wald  has  shown  that  these 
thresholds  are  related  to  the  error  probabilities  discussed  earlier, 
a  and  0  by  the  following  relationships. 


and 


a 


Wald  has  also  shown,  however,  that  no  appreciable  increase  in  a 
and  0  occur  when  the  following  equalities  are  used, 

T  '  .  1  - .3 
a 

and 


Quite  simply  this  means  that  we  suffer  no  appreciable  change  in 
detection  and  false  alarm  probabilities  when  these  equalities  are 
used.  This  is  precisely  how  these  thresholds  are  set  in  our 
implementation  of  the  SLR  processor.  It  should  be  noted,  however, 
that  since  our  processor  operates  on  the  basis  of  the  logarithm 
of  the  likelihood  ratio,  the  actual  thresholds,  Tg  and  Tg,  that 
are  used  given  by 


and 


TL  “  In  TL 
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Finally,  we  introduce  another  threshold  that  is 
used  for  practical  purposes.  This  is  the  threshold  that  is 
applied  to  the  sonar  processor  output  data  prior  to  entry  into 
the  computer  SLR  process.  This  thresholding  is  performed  for  the 
obvious  reason  that  if  all  of  the  data  emerging  from  the  sonar 
output  were  entered  into  the  computer,  there  would  immediately 
arise  a  severe  computer  storage  capacity  problem.  There  are  two 
aspects  to  this  step  that  are  of  concern  here.  First,  by 
thresholding  the  data  there  has  clearly  been  a  change  in  the 
distribution  and  density  functions  of  the  random  process  whose 
likelihood  ratio  we  must  know.  Let  us  consider  briefly  how  the 
likelihood  ratio  is  affected  by  this  thresholding  process. 
Restating  the  likelihood  ratio  we  have 

,  .  P,(x) 

L(x)  ‘  i^57  ' 

Now,  it  will  be  shown  that  if  data  (x)  with  continuous  probability 
density  function  h(x)  is  thresholded  at  an  initial  level  Xp  then 
the  resulting  probability  density  function  is  given  by. 


where 


:(x)  - 


H(Xj)  - 


,*1 

j  h(x)  dx 


X  2  X: 

x  <  X. 


In  other  words,  the  resulting  probability  density  function  is 
changed  only  by  a  scale  factor,  1/(1  -  U(X^)),  for  values  of  the 
random  variable  greater  than  or  equal  to  the  threshold. 

The  proof  of  this  is  quite  simple  and  proceeds  as 
follows.  If  h(x)  is  a  continuous  probability  density  function  and 
if  a  new  random  variable  y  is  defined  by 
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X  if  X  i 


0  otherwise 

then  the  probability  that  y  <  Y  and  that  x  a  'Xj  is  equal  to 


PrCx  s  Xp  x  <  Y]  -  PrCXj  s  x  <  Y] 


for 


Xx  <  Y. 


The  conditional  probability  distribution  of  y  given  that 


x  i  Xj  is 


Pr[XTs  x  <  Y_ 

VY  I  x  4Xi> - r - r1 

y  L  Pr[x  ^  Xx3 


which  from  above  reduces  to 


Fy(Y  |  X  a  #.) 


Gx<V>  -  Gx  <XI> 
1  -  Cx<XI> 


Taking  the  derivative  with  respect  to  Y  gives  the  probability 
density  function  y,  thus 


f  (Y  |  x  a  Xj)  = 


8x« 


1  -  w 


0  <  X, 
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Now  referring  back  to  the  likelihood  ratio  definition  we  can 
write  this  likelihood  ratio  for  thresholded  data  as, 


i>Y  (s) 


p1(x)/(l  -  ^(Xj)) 
P0(X)/(1  -  F0(Xl» 


or 


Lt(x) 


L(x) 


1  -  Vxi>  _ 

1  -  F1(XI) 


Calling  the  logarithm  of  L^Cx),  ^(x),  we  get 


4T(x)  *  4(x)  4-  #i 


1  -  fq(*i> 
1  *  F1(xT) 


which  shows  that  the  likelihood  ratio  of  the  thresholded  data  is 
the  same  as  that  of  the  original  data  except  for  the  additive 
constant,  ln[  (1  -  Fq(Xi)/(1  -  ^(Xj))]. 


There  remains  the  question  of  what  value  of  to 
use  in  thresholding  the  raw  sonar  output  data.  We  have  chosen  to 
use  a  value  of  Xj  which  is  given  by  the  equation, 


-  constant. 


The  reader  will  recognize  that  this  is  just  the  linear  mapping 
that  is  used  to  approximate  the  log  likelihood  ratio.  Our  rationale 
for  using  this  value  of  is  simply  that  a  lower  value  would  admit 
data  to  the  SLR  algorithm  some  of  which  would  almost  immediately  be 
rejected  since  by  definition,  after  the  linear  transformation  it 
would  be  less  than  T^.  To  choose  a  larger  value  would  deny  the 
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SLR  algorithm  some  data  which,  when  mapped,  would  exceed  and 
hence  could  possibly  generate  a  legitimate  track. 

The  second  consequence  of  using  an  initial 
threshold  value,  Xp  that  depends  on  the  design  signal- to-noise 
ratio  is  that  as  this  latter  quantity  is  varied  so  is  Xj  and  so 
then  is  the  amount  of  data  that  is  entered  into  the  computer. 

That  is,  the  computer  loading  becomes  a  function  of  the  design 
signal- to-noise  ratio. 

In  the  same  way  that  computer  loading  depends  on 
the  design  signal- to-noise  ratio  through  Xp  the  performance  of 
the  SLR  is  dependent  on  the  design  signal- to-noise  ratio.  This 
is  true  not  only  in  the  classical  sense  ,  but  in  a  special  sense 
that  derives  from  the  search  and  tracking  functions  of  the  SLR 
algorithm.  As  discussed  earlier,  the  algorithm  uses  projected 
search  areas  for  finding  data  on  one  ping  cycle  that  may  be 
associated  or  linked  with  data  on  previous  ping  cycles  in  order 
to  form  a  track.  It  is  clear  that  if  more  noise  samples  are 
introduced  into  these  search  areas  by  lowering  the  initial  thresh¬ 
old,  then  there  will  be  more  opportunities  to  generate  spurious 
noise  tracks.  This  represents  a  degradation  in  performance.  It 
is  also  true  that  if  the  algorithm  is  modified  to  retain  only  a 
limited  number  of  tracks  by  such  a  process  as  keeping  only  those 
N  tracks  which  exhibit  the  largest  log  likelihood  ratios  ,  then 
by  lowering  the  initial  threshold  and  thus  passing  more  noise  to 
the  algorithm  in  a  given  search  area  the  signal- to-noise  ratio 
required  to  exceed  the  upper  threshold,  T^,  is  increased.  This 


John  C.  Hancock  and  Paul  A.  Wintz,  Signal  Detection  Theory 
McGr^*  Hill  Book  Company,  New  York,  1966,  pp  10d-il2. 

This  is  one  of  the  modes  of  operation  of  the  general  SLR 
algorithm. 


A-25 


6500  TRACOR  LANE.  AUSTIN,  TEXAS  78721 


represents  a  degradation  in  detection  performance.  Fortunately, 
this  is  compensated  for  by  the  fact  that  a  lower  initial  threshold 
also  means  that  target  echo  plus  noise  is  more  likely  to  exceed 
this  threshold.  The  point  of  all  this  is  simply  that  the  design 
signal- to-noise  ratio  is  a  rather  critical  parameter  in  the  design 
of  the  SLR  algorithm. 


6800  TRACOR  LANE,  AUSTIN,  TEXAS  78721 

A. 2  DESCRIPTION  OF  THE  SLR  COMPUTER  PROCESS 

A. 2.1  Introduction 


This  section  describes  the  computer  process 
designed  to  accomplish  SLR  processing  on  multibeam  output  data 
from  a  sonar  signal  processor.  This  computer  process  is  imple¬ 
mented  on  a  UNIVAC  1108  digital  computer.  The  characteristics  of 
this  particular  implementation  are  such  that  the  process  may  be 
implemented  on  a  reasonably  modest,  state-of-the-art  digital 
computer,  such  as  can  be  found  on  board  newer  surface  ships,  or 
alternatively,  on  special  purpose  digital  hardware. 

The  overall  purpose  of  the  SLR  process  is  to  produce 
a  sonar  display  with  reduced  clutter,  wherein  the  digital  processor  can 
perform  ping-to-ping  integration  for  any  echo  returns  not  large 
enough  to  display  initially.  In  this  manner,  the  sonar  operator 
may  remain  alerted  for  longer  periods  of  time,  as  well  as  becoming 
alerted  earlier  than  with  only  the  conventional  processor.  This 
process  has  been  designed  as  a  function  which  can  be  inserted  into 
a  conventional  active  sonar  processing  system  between  the  output 
of  the  signal  processor  and  the  cathode  ray  tube  (CRT)  display. 

The  primary  requirement  for  its  implementation  is  a  digital  computer 
with  sufficient  capacity,  or  specialized  digital  hardware. 

The  information  flow  in  the  SLR  computer  process  is 
shown  in  Fig.  A-4.  The  remainder  of  this  section  is  devoted  to  a 
more  detailed  explanation  of  the  process. 

A. 2. 2  Preliminary  Data  Reduction 

For  the  purpose  of  this  explanation  it  is  assumed 
that  the  output  of  the  sonar  signal  processor  is  time  and  bearing 
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normalized.  Thus,  the  normalized  data  from  the  current  ping 
cycle  are  processed  first  by  the  Preliminary  Data  Reduction  section. 
This  section  has  three  purposes.  First,  the  data  received  are 
grouped  into  single-ping  event  packages  and,  if  necessary,  are 
converted  from  analog  to  digital  format.  These  single  ping  event 
packages  contain  information  such  as  the  range,  bearing  and 
amplitude  of  each  data  point  from  the  processor  output.  In  order 
to  facilitate  digital  computer  processing  with  the  SLR  method, 
the  parameters  which  describe  a  single  ping  event  package  are 
divided  into  resolution  cells,  each  corresponding  to  an  incre¬ 
mental  range  of  the  dimension  of  interest.  For  example,  a  mark 
on  the  display  may  represent  50  yards,  hence  a  suitable  definition 
of  a  range  resolution  cell.  These  resolution  cells  may  be  adjusted 
to  comply  with  both  the  sonar  system  and  the  computer  available. 

Second,  the  section  performs  a  preliminary  or 
initial  thresholding  function  mentioned  earlier.  Third,  the 
amplitude  of  each  data  point  which  passed  the  preliminary 
threshold  is  mapped  to  the  logarithm  of  its  likelihood  ratio, 
using  a  linear  approximation  discussed' previously.  The  output  of 
the  Preliminary  Data  Reduction  section  is  passed  to  two  sections, 
New/Status  Linkage,  and  Secondary  Data  Reduction. 

A. 2, 3  New/ Status  Linkage 

The  New/ Status  Linkage  section  receives  two  inputs; 
one  is  the  reduced  single  ping  sonar  output  from  the  Preliminary 
Data  Reduction  section,  and  the  other  is  the  series  of  multiping 
event  packages  containing  the  joint  log  likelihood  ratio,  range¬ 
bearing  coordinates,  and  projected  search  area  from  the  previous 
ping  status  file.  Each  event  package  is  called  one  status  unit. 
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A. 2. 3.1  Status  File  -  Each  event  package,  or  status  unit 

stored  in  the  status  file  is  represented  by  four  functional 
quantities  which  are  listed  below: 

1.  The  event  position  vector  are  coordinates 
from  the  preceding  echo  cycle; 

2.  The  expected  event  position  vector  for  the 
current  echo  cycle; 

3.  The  search  area  or  volume  for  the  current 

echo  cycle ;  and 

4.  The  joint  log  likelihood  ratio  resulting 
from  the  previous  echo  cycles. 

The  number  of  dimensions  of  position  vectors  and  search  areas 
depends  upon  the  sonar  system.  That  is,  the  number  of  dimensions 
depends  upon  the  number  of  quantities  that  can  be  measured  for 
each  sample  by  the  sonar  system.  The  search  area  or  volume  defines 
the  region  centered  about  the  expected  position  vector  within 
which  legitimate  linkages  can  occur  during  the  current  echo  cycle 
with  the  event  logged  in  the  status  unit. 

A. 2. 3. 2  Linkage  Process  -  The  New/Status  Linkage  section 

compares  each  status  unit  with  the  single  ping  event  packages 
from  the  reduced  sonar  output.  If  the  single  ping  event  position 
vector  lies  within  the  search  area  of  the  status  unit,  the  single 
ping  event  is  said  to  be  linked  with  the  status  file  entry.  When 
this  situation  occurs,  the  joint  log  likelihood  ratio  of  the  new 
multiping  event  is  formed  by  the  process  described  earlier  in  this 
appendix  and  is  then  tested  against  the  lower  decision  threshold, 

V 

If  this  new  joint  log  likelihood  ratio  is  greater 
than  Tl,  then  a  new  status  unit  is  formed,  with  information  from 
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the  old  status  unit  being  processed  in  conjunction  with  the  single 
ping  event  package  to  generate  a  new  event  position  vector,  a  new 
estimated  position  vector,  and  a  new  search  area  for  the  new  status 
unit.  If  the  new  joint  log  likelihood  ratio  is  less  than  T^,  then 
hypothesis  Hq  is  chosen  and  the  track  linkage  is  discarded,  pre¬ 
cluding  the  calculation  of  a  new  status  unit. 

A  status  unit  is  allowed  to  link  with  all  events 
which  fall  within  its  projected  search  area.  Similarly,  a  single 
ping  event  can  fall  within  the  search  areas  of  several  status 
units  and  hence  be  linked  several  ways.  This  procedure  allows  many 
incorrect  linkages,  but  since  all  incorrect  linkages  will  yield  a 
noise  track,  the  process  will  decrease  the  log  likelihood  ratio 
and  the  track  will  eventually  be  dropped.  The  process  will  reach 
a  steady- state  condition  in  which  as  many  noise  tracks  are  being 
discarded  as  are  being  added,  on  the  average. 


A. 2.4 


Secondary  Data  Reduction 


The  reduced  sonar  output  from  the  Preliminary  Data 
Reduction  section  is  also  processed  by  the  Secondary  Data  Reduc¬ 
tion  section.  The  Secondary  Data  Reduction  section  tests  the 
log  likelihood  ratio  of  the  single  ping  event  package  against  the 
lower  decision  threshold,  T^,  and  makes  the  appropriate  decision. 
If  Indeed  the  single  ping  event  exceeds  the  threshold,  a  new 
status  unit  is  created  on  a  single  ping  basis,  except  that  the 
search  area  is  larger  than  for  most  multiping  status  units,  since 
there  is  not  as  much  information  regarding  an  expected  position 
vector  in  the  sense  of  a  multiping  status  unit. 

Upon  initialization  of  the  SLR  computer  process, 
tl  are  are  no  previously  acquired  status  units,  hence  the  Secondary 
Data  Reduction  section  is  the  only  section  capable  of  producing  a 
status  unit.  In  each  echo  cycle,  it  is  here  that  new  tracks  are 
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started.  Note  that  the  entire  process  does  not  prevent  a  single 
large  echo  from  being  entered  into  the  status  file  and  being 
placed  upon  the  output  display  immediately. 


A. 2. 5  Status  Data  Reduction 


The  status  file  information  is  utilized  in  two 
ways  in  the  SLR  computer  process.  As  described  above,  each  status 
unit  is  furnished  to  the  New/Status  Linkage  section  to  determine 
linkages  and  form  target  tracks.  Also,  the  entire  status  file 
is  passed  through  the  Status  Data  Reduction  section.  The  purpose 
of  this  section  is  to  maintain  a  strong  target  track  even  though 
the  current  echo  cycle  did  not  produce  a  linkage  with  this  track. 

This  function  is  accomplished  by  assuming  that  each 
status  unit  linked  with  a  small  single  ping  event  whose  log 
likelihood  ratio  was  just  below  TL,  and  whose  position  vector 
was  the  same  as  the  expected  position  vector  of  the  status  unit 
being  processed.  The  search  area  is  enlarged  to  accommodate  the 
increased  uncertainty  of  target  position,  and  a  possible  new 
status  unit  is  formed.  The  log  likelihood  ratio  of  the  new 
status  unit  is  tested  against  T^,  and  the  appropriate  decision 
is  made.  If  the  new  status  unit  exceeds  the  threshold,  it  is 
passed  to  the  next  processing  section.  This  procedure  helps  to 
avoid  losing  a  well-established  track  because  of  a  single  miss, 
yet  a  noise  track  is  discarded  quickly  because  of  the  degradation. 

A. 2. 6  Redundancy  Removal 


From  the  above  discussion,  it  can  be  seen  that  there 
are  three  sections  in  the  SLR  process  capable  of  producing  status 
units  to  be  entered  into  the  current  status  file.  The  three 
sections  are  listed  below: 


A-32 


. . . ,~. 


6500  TRACOR  LANE,  AUSTIN,  TEXAS  78721 

1.  New/Status  Linkage; 

2.  Secondary  Data  Reduction;  and 

3.  Status  Data  Reduction 

Since  these  three  sections  operate  independently  in  generating 
possible  status  units,  there  is  a  possibility  that  some  of  the 
status  units  will  be  redundant,  that  is,  several  may  have  the 
same  predicted  location  vector  and  the  same  present  location 
vector,  in  terms  of  resolution  cells.  This  redundancy  can  be 
caused  in  a  number  of  ways.  For  example,  a  single  ping  entry 
may  be  formed,  a  linkage  also  formed  with  the  single  ping  entry 
and  a  track  propagation  entry  may  be  formed,  all  with  the  same 
present  and  expected  position  vectors.  The  redundancy  removal 
section  scans  all  entries  to  determine  these  redundancies  and 
removes  all  except  the  status  unit  with  the  largest  log  likeli¬ 
hood  ratio. 


The  output  of  the  Redundancy  Removal  section  is 
the  new  status  file  for  the  current  echo  cycle.  This  is  placed 
in  storage  for  the  next  echo  cycle,  and  is  made  available  to  the 
Output  Display. 

A. 2. 7  Output  Display 

The  Output  Display  section  is  assumed  to  be  part  of 
the  original  sonar  system.  Hence,  the  operator  should  have 
control  of  the  display  threshold,  TD.  By  increasing  this  thresh¬ 
old,  the  operator  can  reduce  the  clutter  to  a  more  acceptable 
rate  with  the  SLR  and  retain  the  same  information  as  without  the 
SLR  processor.  When  the  operator  becomes  alerted,  he  can  lower 
the  display  threshold  in  order  to  look  at  the  status  file  in  more 
detail,  since  a  change  in  the  display  threshold  immediately 
changes  what  information  is  displayed.  There  is  no  need  to  wait 
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for  past  events  to  accumulate  on  the  display,  since  the 
accumulation  has  already  occurred  and  is  stored  in  the  status 
file.  \ 

\ 

Note  that  the  SLR  processor  does  not  include  a 
fundamental  specification  of  the  number  of  echo  cycles  over  which 
integration  will  be  carried.  Rather,  a  single  status  unit  could 
represent  a  track  that  has  been  carried  for  an  indefinite  number 
of  pings.  Note  also  that  a  change  in  the  lower  decision  threshold 
does  not  affect  the  degree  of  clutter  on  the  display,  but  only 
the  amount  of  processing  and  storage.  Hence  there  is  significant 
improvement  over  conventional  approaches  which  allow  ping-to-ping 
integration  only  through  the  operator  looking  at  the  display,  in 
which  it  is  necessary  to  operate  with  a  clutter  rate  sufficient 
to  allow  small  echoes  to  mark  the  display  so  that  the  ping-to-ping 
integration  process  may  begin. 
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APPENDIX  B 

A  SLR  PROCESSOR  FOR  ARL'S  CDC  3200  COMPUTER 


7TH  esoo  tracor  lane,  Austin,  texas  73721 


Bl.O  INTRODUCTION 


A  set  of  operating  instructions  together  with  the 
complete  program  listings  and  flow  diagrams  are  presented  for  the 
active  SLR  program  that  was  implemented  on  ARL's  CDC  3200  computer. 
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B2.0 


OPERATING  INSTRUCTIONS 


Input  data  required  to  run  the  SLR  program  are 
obtained  from  magnetic  tape  and  from  data  cards.  The  tape  contains 
the  detector  outputs  from  the  ARL  digital  sonar  system.  The  tape 
consists  of  one  121  word  identification  record  followeo  by  one 
data  record  for  each  ping  cycle.  The  quantities  contained  in 
each  of  the  records  are  defined  in  the  proper  order  as  follows: 

Identification  Record  for  Detector  Output 


Word 


22 

29 

30 
31-60 
61-90 

91 

92 

93 

119-120 

121 


Description 
Length  of  Data  Record 
Sequence  Number 
Number  of  Data  Records 
Cursor  Bearing  (degree) 

Analog  Tape  Number 
Initial  Analog  Footage 
Day-Month-Year 

Ping  number  Relative  to  Initial 
Footage 

Threshold 

Data  Function  (4000n  -*  detector 
output)  0 

Data  Tape  or  Source  (600q  ■* 
beamformer) 

Time  of  Day  (hour-minute -second) 
Elapsed  Time  Since  Previous  Ping 
Data  Ship 

Ship’s  Speed  (nearest  knot) 
Ship's  Course  (degree,  true) 

Run  Number 

Expected  Target  Bearing  (degree) 
Expected  Target  Range  (yards) 
Program  Name 
63473164c 
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Data  Record  For  Detector  Output 

Word  Description 

1  Range  for  First  Peak  (yards) 

2  Bearing  for  First  Peak  (nearest 
degree) 

3  Amplitude  for  First  Peak 

4  Sum  of  Sample  Values  in 
Normalizing  Annulus  (greater 
than  one  beam  width  from  first 
peak) 

5  Sum  of  sample  values  in  normalizing 
annulus  (within  one  beam  width  of 
first  peak) 

6  Largest  Adjacent  Sample  (on  same 
beam  as  first  peak) 


The  above  6  words  are  repeated  for  every  peak, 
making  a  total  of  6N  words  per  data  record. 


Card  inputs  to  the  SLR  program  define  parameters 
needed  to  calculate  the  likelihood  ratios  as  well  as  control 
parameters  that  define  various  program  options.  These  are  listed 
below: 


Card  Columns 


Description 


1  (6110) 


1-10 

LAA: 

11-20 

IBB: 

21-30 

ITliRES : 

31-40 

ITBR: 

41-50 

LIKMAX: 

Scaled  slope  of 
log  likelihood 
ratio 

Scaled  intercept 
of  log  likelihood 
ratio 

Scaled  lower 
decision  threshold 

Scaled  upper 
threshold 

Maximum  allowable 
log  likelihood 
ratio 
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2  (5110) 


3  (615) 


4  (15) 


51-60 

TDB:  Input  data 

threshold  (dB) 

61-70 

SOLE:  Scale  factor  for 
log  likelihood 
ratio 

1-10 

I PENT:  1-Print  status 
file 

0-No  print 

11-20 

TT0UT :  1-Output  to  tape 

0-No  tape  output 

21-30 

LUN:  Logical  unit  number 
for  tape  output 

31-40 

ISEQ:  Positions  output 
tape  to  begin 
next  record 

41-50 

IT IN:  1-Read  initial 
status  file 
from  sequence 
number  ISEQ  on 
output  tape 
(restarts  a  run) 

0-Do  not  read 
initial  status 
file 

1-5 

NVR(l):  Range  width  for  small 
tracking  window 

6-10 

NVB(l):  Bearing  width  for 
small  tracking 
window 

11-15 

NVR(4):  Range  width  for 
large  tracking 
window 

16-20 

NVB(4) :  Bearing  width  for 
large  tracking 
window 

21-25 

NVB(4) :  Number  of 

independent  samples 
for  small  window 

26-30 

INDL:  Number  of 

independent  samples 
for  large  window 

1-5 

Input  tape  number 
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5  (315) 

1-5 

Input  tape  number 

6-10 

First  sequence  number 
to  be  processed 

11-15 

Last  sequence  number 
to  be  processed. 

Cards  4  and  5  are  read  in  through  system  subroutines 
SEQCARD  and  SEQIN  defined  by  ARL's  CDC  3200  software  package. 

The  SLR  program  listing  and  flow  diagrams  were 
generated  by  a  TRACOR  UNIVAC  1108  special  purpose  utility  program 
and  are  presented  as  follows: 
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ia.  SPONSORING  MILITARY  ACTIVITY 

Commander 

Naval  Ship  Systems  Command 

Code  302-4 

A  general  framework  for  a  computer  system  that  accepts  and 
analyzes  the  vast  quantity  of  data  generated  by  a  modern  sonar  suite  has 
been  developed.  The  output  of  this  computer  system  Is  an  array  of 
alerting  functions  that  measure  the  likelihood  that  a  given  coordinate 
vector  is  the  location  of  a  target.  In  particular,  the  framework 
combines  the  output  of  active  high-  and  low-Doppler  sonar  processors  and 
wideband  and  narrowband  passive  processors.  The  active  high-  and  low- 
Doppler  processor  portion  was  developed  and  tested  during  this  study. 
Performance  tests  using  simulated  data  established  that  the  combined 
active  processor  gave  better  performance  than  each  individual  processor 
and  its  single  output  channel  gave  more  uniform  performance  over 
variations  in  target  Doppler  than  was  available  with  the  two  separate 
channels.  An  observer  test  was  conducted  using  ARL  processed  AN/SQS-23 
recorded  sea  data  with  injected  target  signals. 
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